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OPENING REMARKS: THE UNIVERSITiES , 
AND INTERNATIONAL DEVELOPMENT 

Michael Oibter, President 
Carleton University 



The university has become its own subject of research. 
You are the people who study it. You have not the same 
freedom as other university researchers* for you usually eannot 
frame the questions you answer Someozie eJse does that — a 
president or reetoror vice-ehancellor, or a senate committee, or 
most ofKen, agovemmentdeparunent, a grants committee, or a 
committee ofthelegisfaturr* But sometimes (quiteof^em if you 
are good at your job) you get to ask your own i^uestions. When 
that chance comes* it is worthwhile having important questions 
rn mind. This morning* [ wain to suggest to you some themes 
that 1 rhink are imponant, 

Rrst, I will say something about the intemationalizatbn of 
the university Secondly, 1 will touch on the place universities 
may have in an unequal world where inequalities seem to be 
growing Finally* 1 will turn to some questions of university 
strategy. 

The Internationalization of the University 

For a long time after it was invented, the university stayed 
put Bologna and P^s were founded in the late 12th Centuiy, 
Oxford and Cambridge in the t3th Centuiy^ and Charles Uni* 
versity in Prague a little later By the fifteenth centuiy* uni^ 
versittes had crept over most of Europe, It took two more 
centuries for the m to reach North America. Dun ng the nineteenth 
centuiy, they spread into South and Central America, to tbe 
PhtJippincs* to India^ «> Australia* and to New Zealand, [n the 
Twentieth centuiy, they exploded, and now they are almost 
eveiywhere. In Africa^ south of the Sahara (excluding South 
Africa and Rhodesia), there were only four institutions of 
higher education prior to 1950; by \976 there were 38 uni- 
versities. Nigeria alone has immediate plans for seven more 
universities or university colleges. 

Why and how do universities come intobeing, and how d^^ 
they evolve? To answer these questions for alJ times and all 
places would require a boldness in generalization that most of 
us luckrjy Jack. Nevertheless* J was intrigued by Frank H, 
Bowles' lesser, but stiJJ somewhat breathtaking* theoiy of 
educational development applying to deveJopir^ nations on alj 
continents. The five stages he identifies may, indeed, be 
relevant to the older^ slower pattemsfor univci^ity evolution of 
the past. 

Stage I sees the evolution of a national system of education 
which must prece^ the establishment of universities. Primary 
school, post-primary vocational schools, teacher- training 
schools, and secondaryschooJs are created. In all but a handful 
of casrs the schools act more as sieves to strain out an elite than 
as propagators of learning to a mass public. At the end cf six «> 
ci^t years of primary school, examinations dctennina the 
small fraction who will go on and sort out the survivors into the 
privileged few who will go to secon<lary schooKwhich is both a 
vital direct route to natk>na] leadership and, for a tiny handful, 
the meansof access to overseas universitks}* the less fortunate 
who will take one to four years of general education to become 
'cachers* and the least fortunate who find their way into 
undermanned, undcrcquipped, low prestige technical and voca 
tional schools. 



Stage 11 is marked by the establishment of higher educa-. , 
tion, usually through some of the secondary schools becoming 
first colleges anid then universities, some of the tc3che^tralnlng 
institutes becoming teacher colleges* and more rarely* some of 
the technical and vocational schools becominger^ineenng insti- 
tutes. Universities at this sts^e are staffed largely by insecure, 
uncommitted expatriates jostled by young nationals who seek 
their posts: they are derivative and traditk)nal, embodying* of 
coursct someone else's traditions^ they are primarily teaching 
institutions fpr the public servke, medicine, law and en- 
gineering, arfd they rapidly create disillusionment. Students 
are disappoii^ted by Ihe incapacity of the national cconon^ to 
absorb them, at levels that fulfil their expectations, faculties 
feel they jelnsufficiendy necognized. and governments which 
hoped for instant effects on growth and productivity grumble 
when, inst^d, they find that universities are endlessly ex- 
pensive, centers of student disruption, and sometimes, in the 
early days^ less efficient producers of skilled, high-level man- 
power than the elite secondaty institutions they replace. 

Si age AiU Bowles suggests* anses out of the recognition 
of the rigidities of the systems of fonnal education created in 
Stages I aild IL Something must be done about the drop-outs, 
or the forced-outs* from the formal system. Something must be 
done for tne rural areas, because the schools serve the cities 
and towns almost exclusively. Attention turns to non-foimal 
education, especially in rur^ communities: to the provision 
through short-tenn programs of literacy and simple skills in 
improving farm yields^ in child caret and in family nutrition. 

Stage III merges into Stage IV as the system of fonnal 
schooling begins to adapt itself from an elite education to a 
mass education role and to take on the functions provided by 
ad hoc programs in Stage m. The schools begin to learn from 
years of sad experience to retain students at least to the level of 
functional literacy, to adapt themselves to a wider range of 
social net^dF, and tofit a much higher proportionof the popula- 
tion for mass political participation. The strategies of Stage IV 
are automatic promotkm, free passage to secondary school, 
open entrance for older students, use of media rccognitk>aof 
non-fonnal methodologies — the changcoverof the system from 
a giant sieve to a network of learning centers, 

Rnally, at Stage V comes the adaptation of ihe university* 
It moves in two directk>ns from its early role of training the 
few for a limited range of professions and for public life, first, 
it enlarges its role by expanding program ranges and by uni* 
versity extension work, reaching out to a broader constituency 
as the schools did in Stage IV, Secondly^t develops a research 
capacity adapted to national development goals and, through its 
own graduate programs, reduces its dq)endency on overseas 
Institutions and foreign models. 

1 have belaboured Frank Bowles' development schema, 
giving you an oversimplification of an oversimplification, for 
two reasons, first, because it helps in sorting out thinking 
about how the international spread of the university takes place 
and gives insight into how interunivcrsity relations have de- 
veloped up until the present* secondly, because it lends itself to 
speculation about where universities may, and perhaps should* 



D 



j 



INTERNATIONAL DEVELOPMENT 



go In the future* Let me a vtord on the first point no^^ jnd 
retu m to the second later. 

If one tries to put together the moving picture of the 
uniycrsir>*^cvolution in the JcvelopeJ »oHJ ^^ith the pjtterri 
of it> j^roMvth in developing oountncs* ibe images merge together 
m a klutns> minuet, European universities by the mid 20th 
Centu£> were reaching the end of a ^;omplex cjtle and prvpanng 
to dance a nc>^ figure when the developing countries'" uni- 
versities began a rapid recapitulation of the earl> steps* repeating 
most of the mistakes and adding some of their own* but subtly 
changing mood and movement. The European* and especially 
the British and French* universities had done little to modify 
their traditional role of grooming a governing elite by the time 
they were exported to colonies and fomier colonies. The main 
change they had made »ince the late 19th Century was to stre»» 
research, particularly in the sciences. In so doing» perhaps 
professors became as dedicated to reproducing themselves in 
their students as to producing practitioners of die liberal pro- 
fessions* administrators* anU political leaders. The newer re* 
search emphasis was not immediately exportable to Third* 
World universities, but to the extent that^it modified the 
university cuniculum* it probably worsened the fit of univeisity 
programs to the developing nations' needs. By the time domestic 
change and American example produced broadened* less elite* 
centered university patterns in Europe* the old mould had 
impressed itself deeply on the emerging institutions of the 
Third*World, and the process of rubbing down sharp contours 
stills goes on. 

It is pethaps worth noting* because I \vunt to return to the 
point later, that the influence of British and F^nch universities 
on the Third Worlds and especially on Asian and African 
institutions* was greater than that of North American* or 
Russian, or more *^cntly Chinese universities* not only be- 
cause it came earlier but also because it was based on university- 
ta*ttniversity^inks. Except in isolated cases Jike the Philippines 
and prc*revolutiona(y China* Anfierkan university influence 
was channelled through gpvemn%;nt programs of aid. In the 
United States, as in Canada, university people found their way 
into the Third World as part of a technical assistance program, 
and with some notable exceptions* institutional involvement 
was much less intense. The other side of the flow— Third- 
World students moving to North American or Soviet universities 
for undergraduate and graduate studies — tended also to be less 
muitutionally jnvolvtng. I doubt whether, even now* Harvard, 
or even a specially created institution like Patrice Lumumba 
University in Moscow* can match the influence exerted on 
Third-World altitudes by Oxford or the Grandes Bcoles of 
France, let alone Harold taski's London School of Economics 
in the late 1930sjand l^s. 

Very recently* the wtllingrtess of the British* Dutch* and 
West German governments to fund uni vers ity^M- university 
contacts between their own institutions and those of the dc* 
vcloping world seems to be weakening, I find this distressing* 
not because I bciicvc these contacts have uniformly been 
u^ful and beneficial* but t)ecause the vei^ f^t nf ^ch linkages* 
Mvtth minimal government controL may become tnitial to 
coping with looming world problems. 

Universities and the New International Order 

Let me turn now to some of the huge problems wc arc 
going to have to manage. Radical inequality cannot be per 
petuatcd m a world of closer and Uoser interconnect jon^ ^^hen 
people have been void that things ate going to change. The 
unc<]ual status of remote peoples or groups* of whom orte sees 
or hears little and who seem quite different* may be tolerable. 
When the wealth and ease of others sic daily before one s 



c>cs* inaccessible yc* part of one's expectations^ thc^ become 
intolerable. 

During the I9^0sand 19605* the expectation that under- 
development could be turried into development, (hat conditions 
of life would steadily improve* ^^as solidly implanted. Inter- 
national aid was to be instrumental. Strategically placed* such 
assistance would bring ecX)nomics to the take off point where 
growth could pn^eed on its own. Obviously* these expecta- 
tions were false in all but a few instances. The gap between nch 
and poor countries widens* as does* in the poor countries, the gap 
between rich and poor people. We have begun to look at 
economic aid more closely and to see how pitifol it is in 
comparison to the economic forces that perpetuate inequality. 
Let me give just two examples* 

1, The U,S,, Britain, Japan » and the European Economic 
Community spend between S2I and $24 billion a year on 
direct and mdirect support of their own primary commodities 
that could be imported from the Third World, They spend 
about SI2 billion on net official development assistance, 

2, By the time they are processed and retailed in the 
developed countries, the value of Third-World conunodities is 
about $200 billion. Third World countries receive for these 
commodities about $30 billion. 

Figures are dulL The point is made as well in verse. 
These lines came from Arthur Hugh Clough* who lived in the 
19th Century* when economic aid ^'^as personal* not national* 
fyut probably just as useful. 

""I sit at my tabic, en grand seigneur* 

*'And when I have done* throw a crust to the poor; 

"Not only the pleasure, one's self* of good living 
''But also the pleasure of now and then giving, 
*'So pleasant it is to have nwney* heigh ho* 
*'So pleasant it is to have money*" 

It may become less pleasant before long; but that is not 
the point I wish to make, 

A key characteristic of the international development 
philosophy of the 19^0s and l96Qs was that it made attaining a 
reasonable level of world well-being a goal that could be 
pursued through national policies. The developing countries 
needed an effective national plan* the developed countries did 
their share throi^h bilateral aid policies or* to a lesser extent* 
through national contnburions to mulrilateral aid and technical 
assistance agencies. The experience ofa fluctuation in interna- 
tional commodity prces which throws a development plan into 
complete confusion and wipes out in a few months the effect of 
years of economic aid shakes profoundly one^s faith in naiionai 
policies. The realization that a new international framework is 
needed, that international institutions to cushion the effects of 
monetary fluctuations* stabilize commodity prices^ and take 
the developed world bias outofintemational trade are urgently 
required —these are the insights of the seventies. Only die 
wildest optimist believes such institutions will evolve very 
quickly. But all of us who retain sonnc hope must ask whence 
they might arise. It becomes important* I suggest, to seek out 
institutions around Mvhrch the ethics of inte mat tonal ism might 
cluster, which are common to all countries, which are capable 
of creative imagination* which can rapidly share ideas and 
transmit critical judgments with concern and yet without great 
resentment* 

To no one's surprise, I am thinking of universities. What 
are their chances of evolving* in the developed and under- 
developed countries alike* to a common Stage VI where they 
continue to serve national development goals but increasingly 
contribute to international development? What are their assets 
and liabilities as the hatching ground ofa new intcmationalism? 

First the assets. Universities share an approach to prob- 
lems deeply rooted in reason. They have common standards 
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for testing the qtirtity of evidence and the logie of argument. In 
short, they eommunicate diseiplinc by discipline, with renson- 
able ease. Thc^c statements arc tnier for the phy^iieat and 
biologieal sciences than for the social sciences, unfortunately* 
but even in the latter case, the situation is probably improving. 
Since their rohon d etre is continual enquiry* universities arc 
uncomfortable in the role of dispensing received doctrine. 
Even in states where governmental authority is exercised most 
directly* the university H seen as un unreliable inslnmient. 
Professors cannot do their jobs unless they have access to the 
literature of their disciplines, and the necessary presence in 
university libraries of unorthodox ideas is unsettling. To some 
extent, university autonomy must exist* and although it can be 
veiy severely rcstrieted for fong periods* the inherent tendency of 
the institution is to reassert its claim to freedom of enquiiy and 
lO reestablish intellectual contact with other universities. Per- 
haps it is also worth mentioning the obvious point that the style 
of university interrelationships is nonviolent and economically 
nonexploitativc. Professors make reputations by being intch 
leetually* not physically, overpowering: ui. ,ersUics are usually 
not expected to make profits (the private universities of the 
Philippines* with shares listed on the stock market, are an 
extmordinaiy exception). Finally* universities work on alongish 
tiriie-scalct as governments which contract for university re* 
search continually discover to their great irritation The process 
of thinking through the problems of a new intematior J order, 
though urgent* is probably best tackled by those who are not 
encumbered by the need to make day-to-day decisions. 

On the negative side* it may be argued that universities* 
because of their historic role of producing privileged elites^ are 
ill-adapted to contributing to the sohition of problems ttiat 
have their roots in inequnlity As £^cneies for national dc* 
vclopmcnt In the Third World* they are widely perceived as 
less effective than they sliould be because of their mandarin 
disdain for manual work and their remoteness from the facts of 
poverty It is difficult to believe that professors and students 
are in close touch with niral despair when, for example, it 
costs thiny-fivc times Ihc annual per capita income in Kenya to 
educate a student at the University of Nairobi, If however* as 
Bowles suggests/univcrsitics as they matu(e sharply reduce 
their elitist character and take on roles that relate more closely 
to broad national development* then nt the same time they 
may be fitting themselves better to aid in international de- 
velopment and in the reduction of intemationa) inequalities. 

Strategies 

On balance, tt seems plausible to claim that universities 
can make a strong contribution* perhaps a unique contribution, 
to the evolution of a new international order. But it probably 
will not happen automatieally or without a conscious cfTort on 
the pan of universities to assert their intemationa], as well as 
national, character (Jam vciyeonscious of speaking to you as 
a university president from a country in which the level of 
government responsible for international affairs has Just opted 
Out of direct financial suppon for universities, except in re- 
search* and from a province which was the first in Canada to 
impose differentially higher fees for foreign students,) 

Let me conclude by sketching cenain strategics which 
may enhance the universities* chances of playing a more 
eonstnictive international role, 

i . Rehiforch\g inteftuuionat disdpiintiTy networks. TTicse 
are well-developed in the natural seienees* much less so in the 
social sciences and humanities Most discipline groups receive 
suppon from UNESCO* but not enough. No chance should be 



lost to urge on UNESCO the need to pay more attention 
developing these networks and^ particularly, to extending them 
effectively into the ThM Worlds rather than allocating resources 
to its own already unwieldy bureaucracy, 

2, Cr^otins m<l adapting interhtst ttuiomil Unk^, Here I 
would stress particularly the advantages to the purely internal 
health of the developed countries' universities of increasing 
the intematiotial mobility of professors and administrators. 
Most European and North American universities expanded 
enormously during ihe 1960s and t< ok on a large contingent of 
young staff. Growth hns now slowed or stopped. New appoint* 
ments come rarely* and the need to replace those who are there 
will not come until far-off retirement dates are reached, Tlie 
prospect of university staff growing old and stale together is 
unappetizing* but it will happen unless interinstitutionni rota- 
tion is better organized, ^ 

Exchanges between deve loped *eoun try universities and 
Third- World universities are as difficult as they are important. 
The nature of viable interrelationships vanes tvith the stage in 
development through which the developing country^s university 
is passing. New or young universities will require expatriate 
staffing simply to mount effective undergraduate teaching. 
Part of this need can be met by agreement for '^secondments" 
with established First- or Second World institutions* and ,iiis 
may be preferable to the^direct hiring of individual expatriates. 
The flow of interrelationship between instmtions in these 
circumstances will tend to be largely one way for an initial 
period* although it is vital that it should not be exclusively so. 
For this reason, such linkages fall easily into ihe inadequate 
eatcgoiy of technical assistance and contribute only slightly to 
the working out of new kinds of intcmationnl relations. In 
many TTiird-World universities* however, Bowles' Stage V is 
being reached, Research capacity has been created and the 
possibilities of joint research projects with developed countries' 
universities arc real. Inevitably and properly* such joint re- 
search wilt have to relate primarily to the national development 
needs of the developing country* but it is reasonable to Expect 
that shared insights into these needs will contribute to an 
uiidcrs tan ding of the requirements for a new intematfonal 
scheme of things. 

Here a caveat must be entered, Jt is all ;oo easy for an 
entrepreneuriatly inclined university m a devcloptx! country to 
maneuver a request for* or vague support for* j«>int research 
funding from a university in a developing eountiy simply as a 
means of getting its own interests, and its own people* financed. 
It is precisely this kind of sham that has made the governments 
of some developed states shy away from supporting universtty- 
to^univcTsity projects. If our universities ore to fulfil the eon- 
stnictive inteiTiational role we have outlined* their new relations 
with Tliird-World universities must be based on reciprocity 
and partnership, 

3, Ftmding of Utternathnal links. This* amongst uni- 
versities* especially tho&e based on common research endeavors, 
must come largely from the developed eountriesi. and pressure 
must be exerted not only on aid agencies to finance such 
ventures but also on national re seareh granting bodies. 

If J have stressed the need for universities to develop 
policies lhat facilitate intcnnstitutional links, it is not only 
because T consider them important but also because of the 
audience f am addressing. All of you are deeply involved in 
analyzing the operations of your universities. Your influence 
on policy can be strong, T urge you to use jt to encourage your 
institutions to play the vital role in international developnfient 
of which they are capable. 
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INSTITUTIONAL RESEARCH 1977: 
PROGRESS AND PROMISE 

James Fimberg 
Presidenu The Association far h:stitutional Research 



Bection to the presidency of a professional association 
incurs a few duties and responsibiiities, a bit of privilege and 
honor* and a license to speak one's piece in the fonn of a 
presidential address. Wisdom dictates that the license be grpuited 
at the close of presidential lenme and not at its begmning. 
Ritual demands an evaluation of the progress the association 
and its members are making, and £ssociational vanity requires 
an outlook for the fiiture. ^If^pieservation suggests that it all 
should be done quickly and briefly. 

Let's begm with two statements by well-known and friendly 
critics. Some few of you ntay recall Lewis N^yhew's 
keynote address to the 1966 Fbnim. His candid view raised 
some eyebrows and dropped into our laps a call for progress 
with his statement that: ""Institutional research although >K>w 
well regarded, becoming afHuent, and well suppli^ with 
technic^ devices^ has yet to make a major impact on the main 
course of thinking about higher education/' 

Five years later, Paul Dressel (1971) re-emphasized May- 
hew's assessment and added his own challenge: '"The'Associ* 
ation for Institutional Research is neither large enough nor 
prestigious enough lo give the' institutional researcher any 
great professional stature by his activity in it." 

The candor of these remarks may have alamted some, 
but, nevertheless^ they did focus the spotlight upon two com- 
pelling facts of life: (1) that those of us m the field can ill 
afTofd to rest on our laurels, and (2) that the excellence in 
institutional research already achieved must be combined with 
a decerfpi nation for even greater accomplishments in the ^ituie. 
Has institutional research had an impact on the major course of 
thinking about higher education? And, can the Association for 
Institutional Research provide the professional status and kider* 
ship needed lo do so? The answer in 1977' should be that both 
institutional research and the Association for Institutional Re- 
search are alive and wcIV— and continuing to grow and mature. 
Neither is what it has been^nd both aie becoming what they 
should be. 

With this forward in tnind, let's take a sweeping look at 
institutional research — at where we have been and where we 
intend logo, at the progress of the past years and the promise 
of the future. 

As institutional researcherst we may point with modest 
pride to several obvious successes. Perhaps the most significant 
of these is the collection and analysis of institutional data. We 
have achieved a degree of sophistication in the collection and 
analysis of data dealing with student enroKments* space utiliza* 
tton* faculty work loads* costs* and other information needed 
for planning and management* The recommendations of ihc 
Henle Report, issued by die National Science Foundation in 
1967, are now, for die tnost part, a reality. There is little doubt 
that we have succeeded in developing Systems for Measuring 
and Reporting the Resources and Activities of Cdlieges^ and 
Universities* * . ^ 

Success in the collection and analysis of data points to 
success tn the development of methodobgy for insdtutional 
management and administrative decision making. Hbe, some 
cHtlcs may believe that we have goiie ovcibq^ and quantified 
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too much without qualifying often «fnough. Critics may also be 
found who contend that we have been able to conipjle volumes 
of facts and figures but have not sucoeei^ in using the 
information which the facts and figures contain. 

The managerial revolution described by Rourice and Brooks 
(1966) has succeeded reasonably well without imposing upon 
academe the narrow technocrats that were first feared. Yes, we 
have used our **burglar's tools'* and quantified almost every 
concei^ble aspect of our oigani' itions. However, the central 
thrust of the managerial revolution has involved an informa- 
tional revolution in which we are now moving, from the mere, 
collection and analysisofdat^ to fair information practices and 
the full utilization of Jata and inf(Hinational resources. 

As Bemte Sheehan so aptly stated last year* in many 
instances these efforts **to kno^/ thyself* have enabled others 
to know us — and to know us perhaps too well. The mere fact 
that we have compiled and used facts and figures has Invited 
their use not only by ourselvt::^ but by those outsid^e our 
institutions. In he wake of our attempts at efficient manage^ 
ment» these facts ^d figures frequently are used against us* 

By and laigf:, institutional researchers have been senshive 
to the changing demands and expectatio^is for our institutions 
of higher learning. A university's ^tx>n and purpose change 
as the desires ^nd needs of society — and a sub-set of society, 
the students- -for new and diversified curricula change. De- o 
cisions which efftot these needs and desires must constandy be 
revised and re-evaluated in l>ght of these changes. Student 
preferences or interests in certain fiek > of study are reflected 
in declining or increasing enrollment figures. In some cases, 
we have been able to anticipate changes in student preferences; 
tn other cases* we have not. For example, at my institution we 
see an increased emolhnent in the health-related professions. 
Ten years ago, this field was checked primaiily by premcJ and 
predental students. In 1966* just over 10 percent (yf the fresh- 
men students on our campus indicated an interest in health- 
related fields. In 1976. thisfigure had risen to over20percent. 
What were we able to forecast about this change? Weie our 
projections soptitsticaled enough to know th:s in advance? 
Cduld we handle this particular bansitr^^^ ojfticiently and ef- 
fectively? Were we able to adjust class s^'ies, course schedules* 
faculty assignments, facilities* and ^^^is to accommodate 
the demand? 

The changing interests of students can change the entire 
nature of higher education. If we analyze the enrollment trends 
at many institutions, we find dramatic moves away from the 
traditional disciplines* the liberal arts, sciences, and humanities, 
but an increased interest in occupation ally oriented curricula. 
Given such movesj what is the fate of d^uaditional disciplines? 
Will colleges of liberal arts survive the 1970s, the i980s? Ate 
colleges to become institutions of higher training rather than 
in'ftitutii^ of higher education? Have we as. institutional re* 
searchers even asked these questions? 

Thif next decade will not be easy for institutionaf researchers, 
but it may well ^ the decade In which institutioi^ial research 
proves its mettle* the traditional collcgc-age population of 18- 
to 24-year-olds is expected to d^tine in the 1980s, and how 

\ 
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vtcW in^tttuti^rtrii rescorvhecb i^an help institutions adjust may 
well prove their value in inititutional planning and management. 

The uncertainties of change are a persistent problem in 
institutional r&^eaich. No longer i^an we rcl> on olii methods 
and i^onu^pts of msfitutional adaptation. We need to fonnalatc 
dnaMarcnc^uf ^hi^nge that s>stematic, i^nticah and innova- 
tive. It IS e^ntial thai vt^ make bruadi m-depth an<il>M;s vvuh 
respect to institutional i.hange and meet the requirements re 
suiting from those analyses. 

This shifting emphasis as welt as stabiliziiig or declining 
onrullntent should S^^c u.ause for ^arm since man> of us are 
funded by enrollment-driven, number-conscious processes. 
More students nfiean more dollars, le^s students mean less 
dJIdis, If wontinue to be funded m this m<inneri enrollment 
dcct^ite^ Mill reduce our budgets more rapidly than we i^an 
reduce our ^oMs. If budgetaiy pruning becomes a ne4:essit>r 
vvho IS m a better position than we to study and recommend 
ivhejr^r Mhcn, and hovr tins prunmg should take place? If we 
du not take steps tv^oiard selective pruning^ we should not be 
offended when across the-board cuts or wholesale trimmi,«gs 
takes place. As early as 1971, Clark Knrr warned that, '*Cost- 
effisctjveness of operations will be more carefully examined. If 
this is not done internally* it wHI be done externally by the 
'no^ e^pcils' working.for legislatures and governor^,'"'' 

The planning functions of the institutional researcher 
should receive special attention from both the profession and 
the Assot^iatjon for Institutional Research, Even institutional 
researchers have been reluctant in the past to accept the re* 
sponskbdities of plannir^F they no longer can dissociate them- 
selves from the planning function, :>ome may disagree with 
this viewpomt, but suggestions as to which course of aetion is 
to be followed should be made from the objective viewpoints 
of the inslttuttonal research officers who, because of the in- 
fbnndtton they have gathered and analyzed, are probably the 
must know IcJ^eable people around on the subject. Institutional 
le^archcrs should brid^ the gap, through effective ^ommum 
wdtton, between fi^ulty ami administration, between opposmg 
admmistrattve forces^ always with the be^t interests of the 
institution in mind. 

Along similar lines, institutional researeh must increase 
mvoLcment with decisions made at the departmental level. 
The iepartment thatipei^on is low on tfie hiciari^hiuil totem 
pole ^f a college s decision making process, bjtit tt is at this 
level tha, ' Jilt decisions" arc made. Almost daily the depart 
ment thairpcfsoti onfronts problems relatir^ to faculty size 
and tiualifl^r4tion la^ulty work loadr facihtiest and programs, 
und at this Ic ^1 the (Quality of an iiistitption is determined. 

The infitm] step in any systematic process is cmcial to 
success. Efficiency and (]uality at the departmental le ^1 are 
Cftscntiai, We must gear our efforts^ therefore, to helping to 
impfovc the quality of decisions at that level and to facilitate 
the larger decision making proce^^ of tfie institution. We must 
remember that it i> a relatively simple task to aggregate depart 
memal data to the i.ollegc or division level and from there to 
the inMitutmtdl level. It is impossiblci on thcotfier hand» togc 
in the other direction, 

\\%\c we M pijvidirig the department chairperson with 
mfonnatton '.,«d reporting findings on this level, and in all 
4ispei^is of institutional research, we need to become more 
aware of the importait^e of effcchve commtim^ation, whi^h 
mi^lode dissemmatirig information among ourselvest a 
i^omprchensive system of reporting our fmdmgst and a s>»tem 
lu provide feedbavk for evaluation of our research, Intennstitu 
tional data e^i^fiange Uonnal and mfortnal) is anothe. fonn of 
kOmm^jpication that is important. If it is useful to make com 
parisoTl> Mithm an institution— con anng, for c^amplct soci 
ology with hi&tuiy — wouldn't it be more beneficial to compare 



history in one institution with histor> in another ^imdar 
institution? 

The increasing role of institutional researchers in the 
fofmulation of policy and planning may include an involve- 
ment in politics to achieve dcsirt^ and objectives, \ 
realize ihai poiitUs is a dirty word to many, but jt isarealistK 
and logical offense. So many decisions relating to colleges and 
universities in the public sector— and even ^hose m the private 
sector iu the United States, Canada, South America and EUnDpe^^ 
are political, that it is almost a necessity that institutional 
research officers play an active role in the political struggles 
that directly pertain to their institutions. 

Another concern of the institutional researcher should be 
the need lo minimize e^temai influences affe^trng institutional 
autonomy, I see these eMemal influences as one reason why 
we have not accomplished all for which we may have hoped. 

Earlier this year. The Chronicle of Higher Education 
published a tO-Year index. Under the topic heading, Governance, 
there are scores of articles dealing with external inflt^enccs on 
institutions, A !?ricf listing of some of these follows, 

Colorado regents clash on academic freedom, tenure, 
patriotism 

Dean fired* dispute erupts in Texas 

Judge rules tW SUNY at Albany trustees must approve 
the way student fees are used 

Grand juty to investigate Ohio U trustees 

Vermont court backs trxistec control of student activity 

fees 

Maine governor asks for resignation of entire U of Maine 
board 

Ohio governor aims to cut regent's power 
West Virginia governor rescinds authority of board of 
regents 

Governor Brown's effect in California. 

At ihis point, we dare not slight federal bureaucracy . The 
burden of federal paper wjrk has come under considerable 
scrutiny over the Pas^t year, and several national panels, com- 
mittees, and taSfv forces have been delving into the <Iuestion. 
AIR has had considerable input into the issue, and it should be 
One of continuing conccm. 

As institutional researchers, we were beginning to bring 
tei^hniui] knOwlecTge to bear on internal problems and pressure 
when external pressures and influences became almost unbear 
able, A point of sophistication had been reached in the manage 
ment of higher education that produced sufficient data and 
analysis for internal problem solving and decision making. 
Rather than confine this information to internal institutional 
researchers are called upon to facilitate its external use. 

I recall when I went into institutional reseaiwh thirteen 
years ago that our major function was cxtcmal ref )rting, Afier 
some period of time, we were able to routinize this external 
reporting funUion and concentrate On the dcvclupment of data 
systems to support internal decision making. We have almost 
come^around a full 360 degrees. Just to give you one examplcr 
during the twelve months from October 1975 to Scptcndbcr 
1976, Our office had equivalent of one staff member 
working for agencies outside the university system. Most of 
the HEGfS Reports, BBD 6, salary reports, and so on are 
comouterizcd* so the completion of a report is almost a matter 
of tiansferring data from a printout to a printed fonn. In some 
institutions, particufarly the smaller ones where the a^atlabilit) 
of computers is not so great, I would vcntuie to guess that at 
least one person is involved in cxtcmal reporting. Extending 
this notion across the more than 3,000 institutions in North 
Anterica, the costs would be staggering— particularly when you 
add in data processing time, other time outside the institutional 
research office, and time to develop data bases to support 
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reporting A cost/benefit analysis of ihe Jarjgcr process could 
be interesting. 

Now lhat we have discussed external aspects, we should 
also devote some attention to intemal^ evaluation which is 
another challenge "of institutional research. Everett Hopkins, 
speaking ^ our 4th Fomm on llie Role of Institutional Research 
in the Evaluaiion of Policy^ asserted that "internal evaluation 
isnot only a legitimate function of institutional research^but It 
is a necessary one." 1 believe i^ is one of the most essential 
functions of institutional research. The old proverb, "'physician, 
hea thy >clf," is certainly applicable here. Inasmuch as we aie 
able ;>ct our own house in order, odiers wtM be able to follow 
our example. « ^ 

The challenges facing institutional research in the future 
are formidable ones. It will take our patience, knowledge* and 
energy to meet these challenges. Our efforts must be channeled 
into (a) helping define the objectives of college and universltEes. 



(b) continuing to analyze the decision-making process^ ',c) 
taking a more active role in the creation of policy and institu- 
tionaJ planning, (d) exploring the elements of change in insti- 
tutional systems, (c) developing mom effective means of com- 
munication, (0 minimixlRg external influences in higher edu- 
cation, and (g) maintaining involvement in interna] evaluation. 

We have come a long way since Mayhew and Dressel 
made their observations, but we still have a long way to go. 
The future of instttutiona) research is dependent on aJl of our 
efforts to engage in new and innovative research that will make 
what Mayhew (1966) alluded to as "a m^jor -mpact on the 
main course of thinking about higher education" (p. ]). If we 
have not matfe such an impact in the past, we should not be 
hesitant to strive for impact in the future. Institutional research 
has a short history, but some of us believe it has a promising 
future. 
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One needs U> begin a discussion of the chief executive 
officer's view of institutional research with a statement of the 
overall purpose of institutional research in a college or university 
setting In rriy view, the purpose of institutional research is to 
improve the quality of decision making at all levels withtn the 
' institution, hut especially at the central adminisu^ive level. In 
attempting to fulfill this purpose, institutional researchers are 
forced to cope with three' major dangers: first, the temptation 
to conduct excellent studies on the wrong topics; second, the 
temptation to conduct inadequate studies on the right topics; 
and third, the threat that si4>enor studies on the right topics 
will, in fact, never be used to improve the quality of decision 
ma)cing. 

In order to cope with these tlnce problems^ the challenge 
facing the institutional researcher is also threefold. First, the 
institutional researcher must somehow work sufficiently closely 
with the chief executive officer and other key members of the 
central administration to be in a position to identify both the 
short- and longer range problems that face the instiiution and 
to identify the decisions that will need to be made with respect 
to these problems. The second challenge, of course, is to 
devise a research methodology sufficient to attack the problems 
in decision-relevant terms. Requi'^d here is the professional 
expertise of the institutional researcher And finally, the instini- 
tional researcher shares the responsibility, along with the cNef 
executive ofticer--the president or the chancellor — to get the 
results of institutional research into the mainstream of decision 
ma)cing. 

The problems confronting institutions in the years ahead 
will undoubtedly vary from institution to institution. At the 
same time, there are four problem areas that are likely to be 
common to most colleges and universities. The first is that 
changing demographic figures, including a decline in the con- 
ventional coUege-age population^ are likely to present most 
institutions with the problon of inaintajning emollrnent stab3ltty. 
Enrollment stability will be a manageable problem ih the yi'ars 
immediately ahead, but during the latter part of the I980st it 
may be a problem of overriding concern for many institutions. 

Secondly, related to the problem of enrollment stability 
will be the challenge of maintaining financial stability. Infla- 
tionary pressures have hit colleges and univeisities with special 
severity These pressures are likely to continue. Faced with the 
prospect of stabilized oreven declining ehrollments, one of the 
major sources of income for many institutk>ns, tuition revenue, 
is Itkety to become a less reliable source of financial support. 

A third problem arcd that will be common to tnost institu- 
tions is the challenge of maintaining institutunal vitality. I 
refer here to maintaining faculty vitality^ a curriculum that is 
alive and up-to-date^ and an attitude within the instiiution 
conducive tp InL !cctual commitment and accomplishment. 
The prosp^t of stable or declining enrollments, along with 
financial stnngencies, is not the climate in which most colleges 



and universities have nurtured V^titutional vitality dunng the 
last iV/O decades. Quite to the contrary, institutional vttaliiy 
has been nurtured /in most colleges and universities in the 
context of growth arid rapidly expanding resources. New pat- 
tertis for maintaining institutional vitality in the absence of 
emollment growth and with the reality of growing financial 
stringency will be needed. 

Finally, a fourth area of concem likely to face most 
colleges and universities is that of maintaining colleg^al stability. 
Colleges and universities face their own pressures and problems. 
TKey are, however, also a part of the larger society, and the 
strains and stresses in our society spiil over onto the campus. 
Energy, the economy, the availability of jobs — these and other 
wietal issues are likely to place increasing strains on collegia! 
stability, that is, the cohesiveness of the academic enterprise as 
we know it. 

What do these four problem areas suggest for the role of 
the institutional rcseaKher? Mr-:c than ever before the institu- 
tional researcher must be r highly skilled individual with a 
clear sense of professionalism. He or she must be knowledge- 
able and accepted by many different members of the academic 
community, including the faculty, the student body, and the 
administration. In order to understand the needs of the chief 
executive officer and the central administration generally^ it is 
essential that the institutional researcher be subject to the 
widest possible spectrum of contacts and understaiidings. It is 
this cornprehensiveness and the related demand to relate to 
multiple constituencies that is characteristic of the role and 
responsibility of the president or chancellor. To be helpful in 
the decision-making process, the institutional rese^her must 
not only appreciate the comprehensive perspective of thechief 
executive officer but must apply this comprehensive view to 
the study of institutional problems and in the testing of realistic 
options. 

From the perspective of a college or university presi- 
dents there may neverhave been amore difficult and demanding 
period in American higher education in which to provide 
creative academic leadership than in the decades immediately 
ahead. College and university presidents need your help. Ex- 
cruciatingly difficult decisions will i.'ced to be made. Hopefully 
they will bejmade on the basis of the most enlightened and 
sophisticated analyses of problems and altema^ive sohitions 
that we can inake available to them. 

As youllook ahead to this challenge, I urge you to gji >o 
know the chief executive officer ofyourinstimtkm. Understand 
better than you do now the problems and pressures he or she 
faces. Work deliberately to win confidence and respect. And* 
of course, tend alt the help and support you can. Clearly, it is 
needed. This will not only make your role within the institution 
more satisfying and productive, but, hopefully, will also lead 
^'to stronger and more responsive educational programs and 
institutions in the years ahead. 
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Mr* Lawrence; 

There is almost universal agreement that institutional 
autonomy is a cornerstone eoncept for maintaining diversity 
and quality in Ameriean higher edueation. At the same time, 
we reeoghize that state governments are properly eonccmed 
with the effieieftcy and effeettveness of publie ir>:;iiutlo[i5i 
and, indeed, states have asocial obligation toeneouiage these 
virtues in private institutions. The issue is joined when state 
regulation, and sometimes outright eontrol, over many aspcets 
of higher education appears to eneroaeh on itistitutional auton- 
omy. State regulation or control is defended as a proper means 
for making sure that publieity supported educational programs 
are, in fact, responsive to societal needs. But this regulation 
and eontrol often is seen at the institutions as an infringement 
on justified and needed autonomy — a threat to diversity and 
<)ualjty and to all the social needs that depend on them Tor 
fulflJlment, 

There are reasonable limits to institutional expectations 
for autonomy — and reasonable limits, as well, to state regula- 
tion and contTt)l. Within the context or that general recognition, 
some specific issues are currently being debated, 

Regarding diversity, fbrexample, one question is whether 
it must and should tc lefi to autonomous Institutional program 
decisions or whether there should be a centrally devised* 
state\vide plan for diversity in higher education. How does one 
plan for diversity at the stale level? Many institutions^ looking 
to experience* are convinced that diversity is a by-product of 
institutional growth a;id that it is motivated in large part by the 
institution's own aspiration to improve <)ua]ity. But when 
resources and demand wiJJ no longersupportgenemlized growth 
in higher educatioui how can the state' make sure that diversity 
is not being maintained at the expense of wasteful duplication? 

Another specific issue 15 that of admissions standards. 
Has an institution receiving public Hinds the right to refuse to 
accept transfers of credit to meet its dei^rec requirements or to 
refuse to grant credit on the basis of coljege-levcl examination 
performance? And of course* admissions requirement issues 
generate equity questions — questions about which society is 
becoming inbits^singly sensitive and poJitieally aggressive, 

Mr. Relilst 

The theme of totlay's session points clearly to the new 
reality in publie higher education, at least the new reality in the 
United States. We live amidst the product of our recent history, 
which has established a hierarchy of educational authorities in 
place of tile Simple ones of an earlier time. The chain stretches 
from the individual colleges and univer^uies marked s£ilJ by 
traditional '^jcw^of self-govemancc^ through the central offices 
of numerous university systems working out the means by 
which they will control their many campuses, beyondt perhaps, 
to state coordinating boards busHy perfecting their mechanisms 



of authority at a higher JeveJ of aggregation, and even out to 
otfjer state agencies which ostensibly have nothing to do with 
hfgher education but which have some degree of ^minion 
over it. The details vary from state to state^ but the general 
pattern is, indeed, the new reality. Hard financial times have 
fed its growth and now insure its perpetuation. 

The polarities in which we university people often talk 
out our tensions, in this ease the polarity of central authonty 
versus campus autonomy, frequently betray by their very<^ 
wording that none of us settously believes in thcr extremes of 
the issue. In the westem world, the images evoked by words 
like central authority at once rvn afoul of a neh litany of 
individualistic values that warn us to be wary of resting a case 
at that extreme. We are suspicious of oi^ganizations, even those 
called states, if the organimons are allowed to infnnge the 
freedom of individual citizens to arrange their own affairs 
within the gentle confines of society's legislated or commonly 
hel<i norms of social behavior. Similarly, we use terms like 
campus autonomy km^\i\gi\A\^f:\\ that, if taken at our literal 
wordt the attainment of autonomy would give us Jar more 
freedom than we seek. The extretpe of campus autonort^ 
could exist Only in a condition of divorcement and disinterest 
between the university and its publie, which would then no 
longerbeasustainingpublie. So truth and wisdom do not lie at 
that end, either. Good public policy lies bctweeut in some 
appropriate balance of freedom and constraint — freedom which 
does no injuiy to the larger social order and constraint which 
draws back well short of totalitarianism. The rights of a 
campus should not be equated with the rights of the iHtvidual, 
of course, but this Oifference merely complicates the philo* 
sophieal issue and does not change its' nature, 

Sot [ begin by rejecting the theoretical extremes. Even the 
most militant champion of campus self-govemanee must 
recognize that society cannot survive without mechanisms of 
eontrol for the institutions it finances in the public interest, and 
even the most aggressive centralizers must know that the 
people on the educational firing line am in the position to be 
most sensitive to the workings of the enterprise. 

This is not to say that we have no important issucLjiere, 
however. On the contraiy, today*s theme offers access to a 
grave set of problems. It is my E>cllef that the emergent chain 
of overlapping authorities which now struggle to govern and 
direct our public colleges and universities in the United States 
is heavy with threat to the purpose and the^propcr working of> 
the educational enlerpnse. The somber accent of our tinfies is 
On the social control of institutions of learning and not on the 
liberation of learning itself. My sense of things is that we mu^t 
somehow reverse the emphasis without losing sight of the 
necessity for social control. 

How? I doubt that the riddle we face is» in any funda- 
mental sense, a problem of theoiy. We will not find solutions 
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in a perfected theory of ihei^taKior m a more refined model of 
au'tiunUible social orgamzatLOTi, or m ever more mtricale 
expltcatiOTi!^ of the principles by which centralLzed and de 
centmtized authorities mi^ht be caused to ^vo^k hannomously 
together. Our dieories are good enough for now. 

There is more progress to be made, 1 suspect, in taking a 
freshly analytical and behavioral look at the governance or 
central mechanii^ms themselves — the ageneies \^hich stand 
between the eamptiscs and the ultimate executive and legislative 
authority of state government — with a view to discovering 
whether they are achieving the purposes for which they were 
created and with the additKinal view of identifying any educa 
tional debilitjeik their nse may have caused. University systems 
are a sufficiently old phenomenon by now to have amassed a 
great wealth of data for the analysis of their behavior, and the 
same can be said for siate coordinating boards and state depart- 
ments of education. The literature delving into these sources to 
date telU a good many success stones* but there are tendencies 
in the picture that offer grounds for concern. 

Bureaucracies that are formed to meet state purposes 
seem to have a way of developing their own internal dynamics 
without apparent relatioii to the philosophy of the state that 
fonns them and w ith unexpected results. This is not a lament 
to the anival of die 20th Century because I happen to believe 
that the instrument of bureaucracy h one of the most powerful 
inventions of m^' jm civilization. It makes possible the eflfkient 
performance ol massive labors, and abandoning it and its 
benefits would be unthinkable. We appear to be turning a 
komer in the American perception of government, however, 
and there re more cnties of large-scale bureaucracy today than 
at an> Lme in our history. Included amoi^ them are many 
liberals whose fathers were disposed, t suspect, to disparage 
advocacies of small government. Included, also, are .many 
spokesmen for higher education who feel themselves to be 
drowning in a sea of governmental regulations. Similar anxieties 
arise from other sectors of public life, and the Caner adminis- 
tration 15 responding widi efforts at some major reorganizations 
and simplifications of the federal establishment Here is the 
grand symbol of change. We find ourselves speculating about 
how long the mood will last, what wiU con. . of it, and even 
whether it is possible to hope fer change. Wc thus confirm a 
general recognition, pointed out long ago by Max Weber, that 
bureaucracies do respond to their own resistant and durable 
dynamics. For all we know, they may be beyopd the control of 
anyone. 

Let me identif> quickly afewelemcfus of the bureaucratic 
dynamic with which we must all have Itad some experience. 
Bureaus work with items which can be erh*gorizcd by type, 
according to their common and objective features, and can 
thus be dealt with by routine processes which avoid the demands 
of dealing with every Item novOf as though it had no 
counterpart. Personnel officers eategortze jobs according to 
the skdis required and workers according to the skills they 
possess. The central offices Of university systems eategortze 
things called cam^ses and formulate general policies which 
apply to all equally , m accordance with their shared attributes. 
And so on> Inherent in the process is die possibility, perhaps 
cvt:n the virtual necessity, of ignoring whatever unique attri- 
butes a unit may possess in order to keep it contained within 
the category^ because if it cannot be thus contained, it cannot 
be dealt with in routine ways. 

Arguments inevit&bly ensue, of course — the spokesmen 
for the unit sa>ing to higher authority, " Vou do not understand 
us,*\ meaning that unique attributes are being ignored, and 
higher authority answering, '"We do, too^" meaning that they 
have gone as far as they can without blurring the requirements 



of the category. One conscientious way in which this kind of 
conflict is handled is to examine the chaFOcteri sties being 
claimed as unique to see whether they are prevalent in sci^ral 
units of the category, if not in all, so tl^t a subset can be 
recognized which will sustain a limited amendment to the 
general policy of the eategoiy, tt works in a sufficient number 
of eases so that we observe in bureaucracies a tendency for 
policies, even if simple at the outset, to grow into elabone 
regulatory codes. 

tt follows that the more complex the governance routines, 
the heavier are the mar-power requirements of the system. This 
creates the threat of enlarging overhead costs, and it also 
establishes the ground for a professionalized staff whose careers 
consist in understanding the codes, managing their data needs, 
and advising policy officers as to wh^it it all adds up to. Here* I 
think, is an example of the way in which the self generating 
dynamic of bureaucracy can escape old notions of a theoretical 
nature. The old notion is that line officers in complex organi 
zations are the ones who make the important decisions. But 
who working in bureaucracies is so naive as to think that we 
ma> stop them in our efforts to influence action without also 
influencing the sheltered staffs to whoni line officers turn for 
guidance? Staffs— the technocrats, as John Kenneth Galbraith 
terms them, have long since become a new class of workers In 
the game of power* V 

t skip quickly over the tendency of bureaucracies to 
generate colossal flows of paper because it is too widely 
observed to need comment. When one combines dependency 
OT} categorical procedure with curbed attention to uniqueness, 
with elaborate codes of regulations, with professionalized staffs 
of,eode interpreters, with dependency on the written record, it 
can all become ponderously slow. This might be okay tf the 
world could be slowed down to fit bureaucratic response time, 
but, alas, die world seems instead to have speeded up. So the 
frequent complaints of people on the operating line wc will 
say campus presidents in this ease — are that they receive 
disapprovals that th/^artaets they believe to be necessary to the 
entcrptrisc and approvals that arrive too late to be of much use 
At the extreme, there hovers over the bureaucratic scene a 
spcet<^ of entropy in which much energy is dissipated within 
the syj^tem. massive inputs of effort result in dilute outputs in 
Ihe fdrm of social benefits. 

My own state of New York is, to use an Albany euphe- 
mism, a highfy regulated state which manifests its share of 
these ehai^teri sties. The university, in appointing administra- 
tive and support people, must contend with a personnel system 
of .seven grades of employees with salary boundaries for each 
g^de. On topof thisisan ''imp9Ction"rule that requires a new 
employee to be appointed at a below-average salary for the 
grade if the aggregate salaries for incumbents average at, or 
above, the stated average for the grade. Obtaining exceptions 
is a labyrinthine and unreliable adventure. We tind ourselves 
eopirig with the internal regulations of no fewer than six state 
ageneies in order to get the actions that are required for the 
ongoing work of the campus. In instanccc, the tndepcndendy 
developed regulations of two or more ageneies have interactive 
impact on each other that makes it virtually impossible for the 
university to spend Its full appropriation. This would seem to 
mean that technocratic activity is thwarting legislative deter- 
mination without anyone's intending it. (Of course, in the 
recent yean of the fiscal crisis the Division of the Budget has 
intended it and has established expenditure ceilings and hiring 
freezes that have this effect.) We recently did a flow study on 
all of the campus- initiated actions requiring external authoriza 
tion somewhere or other and found that the time lequired to 
ohtam approval to fill a vacant position is, on theaverage, four 
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weeks; to purchase ma^r items requiring bids* 15 weeks* to 
purchase items not f^uiring bids, four week&, to travel either 
in or outside the stale. Hve weeks. 

New York canajso offer examples ofanother phenomenon 
which develops not from the dynamic of any single bureaucracy 
but from the rivalries between several of them as Ihey contend 
for power in a time of scarce resources. A serious preoccupa- 
tion Just now on the campuses of Ihe State University of New 
York (SUNY) is the heavy degree to which cducalional decision 
making in operational matters has migrated beyond the con- 
fines of SUNY into the domains of the State Education Depart 
mentor the Division of the Budget In one important arena, the 
State Education Department's program of review of doctoral 
programs, interagency rivaliy has produced two years of stulti- 
fying controversy with no end in sight. The controversy has 
been reported periodically \n ihc Chronicle of Higher ^ucmon, 
so I need not detail it except to say that the Board of Trustees 
of SUNY brought suit 15 months ago against the Commissioner 
of Education and his Regents in order toget a determination as 
to which of the two legal bodies should exercise the power of 
dercgistering degree programs. The case is now proceeding on 
appeal, the detenninationof Hrst instance having gone against 
SUNY It is not rKicessarytoknow which side of the controversy 
is right in order to know that it is a controversy, that a lot more 
than the delivery Qf education is involved, and that a great deal 
of energy is going into it on both sides. Meanwhile, baek on the 
catnpu&f we Work to improve all degree programs, including 
the doctoral programs in English and history that became data 
points in the great authority struggle. 

I don't mean to belabor New York* because these char^ 
acterisftics can be duplicated in many states. Despitu the com- 
plexities of a 64'campus system* SUNY works remarkably 
well; we Hnd ourselves moving forward even in Hscal strin- 
gencyt and there arc many officers— in SUNY CentraL in the 
Division of the Budget* and in other agencies — who understand 
the sometimes^ mindless tendencies of bureaucracies and work 
effectively against them. But, there is no denying we are 
caught in a maze Even Mark Twain would be sorely pressed 
to preserve his sense of humor. 

What are the prospects for refonnation of the educational 
bureaucracies at this stage of the nation's history? Without 
po4;1ng as a scholar of complex organizations, or even as a 
fullycognizant student of all that has been written about them^ 
my sense of the literature is that it presents very few examples 
of bureaus which have turned themselves Inside out and moved 
off in another direction, while reducing themselves in size or 
scope w^re it not for my noimatpve view that this may be 
precisely what the dme^ require of thcnfi, 1 suppose 1 would say 
that the behavioral studies are all against iL 

It is worth observing t however that the history of the rise 
of bun^aucracies(of all sorts including those having todo^ith 
education) has been contained whhin a long tenn period of 
geogiaphic. demographic, and economic expansion in the West 
that has no parallel in previous periods of worid history. The 
bicentennial celebration in America has reminded us that our 
Hnt two ceMurics were occupied with pressing national bounds 
arie^ westward and beyond, growing rapidly in population^ 
and becoming a world economic power Could it be that bu- 
reaticracies have been nnercly reflecting the expansive climate 
of the larger society in which they arose^ that they have 
behaved in their apparent way because there was no con^lling 
reason for them to do otherwise, and that scholars of bureau- 
cratic behavior have been in no position to discern whether the 
fundamental forces at work were intrinsic or extrinsic to the 
orgftnization? 

We may beabout toHndoutt because the third American 
century promises to be quite unlike the Hrst two. Physical 



expansion for the United States is over, population growth hasi 
slowed* and economic growth is predicted to be gradual for the 
long future. We appear to ^ passing across a great historical 
discontinuity which has fallen to our generation of citizens to 
negotiate. We call it steady-statci and the slogan of the new 
age is ready at hand: Small is beautiful. 

Let me offer the hypothesis — it could ^ no more ai this 
point — that the growth patte m of educattonal bureaucracies is 
largely a result of extrinsic forces, that the agencies can adapt 
and even shrink in response to external constraints, that they 
can refonn themselves in new directions, and that they can 
even turn back to the campuses and appreciate the inescapable 
fact that knowledge neverexpands by routine but only as novel 
clues are pursued to the discovery of new truths. 

It Is a new environment we face, and I am inclined to 
think that these huge old ammals cannot survive in it. 

Mr. Mautz! 

Dr. Fields has produced an admirable statennent. U prop- 
erly points out that total independence of ^ny individual, 
organization, or natk)n is a goal which is not attainable. The 
Corollary is that some regulation and accommodation is essential. 
He thoughtfully points out that an historical period for the 
country and indeed western civilization has come to ^ ^rid. 
Where we are ^^oing is unclear. It is clear that a national debate 
on goals* means of attaining those goals* and allocation of 
authority and responsibility in alt^^as of society \^ now 
underway^ 

I might aid in our t^iinking if I were to sketch for you my 
undet^tanding of why "centralization of higher education oc- 
curred. Everyone understands that the flow of automotive 
traffic requires control at the local ?nd state level and that to 
assure that an interstate highway is not a road to nowhere, 
some coordination, and even coercion, of states is required on 
the part of the federal government. Roads must meet, they 
must be able to withsitand approximately the same load Itmtt^ 
etc. We all accept without question the nce^^ssity for strong 
federal intervention in the control of the manufacture and sale 
of food and drugs, and we readitv concede the necessity for 
federal control of the environment in order to eliminate dc' 
stnietive competition between states. Many do not so readily 
concede the necessity for central regulation of educational 
efTorts and 1 202" is a Hghting slogan for some. I preface my 
version of the development of central bodies by commenting 
that r wise man once remarked that changes for the better 
inevitably signify the loss of something good. 

I To state that states upported universities have traditionally 
been autonomous is to exaggerate. History is replete with 
examples of something less than independence. But they were 
independent of a state governing orcoordmatmg board and had 
more autonomy than they have today. In theirextemal political 
relations, for example, they dealt directly with the legislatures. 
Presidents urged sympathetic legislators to adopt funding re- 
quests. The resulting appropriations dctennined policy* the 
location and the size of ^ building, the inauguration or expan- 
sion of academic programs, and the competitive relationship of 
each institution. The affairs of state govemmcnt were relahvefy 
simple. Legislatures met infrequently, budgets were small, 
and decisions, although signiHcant, were relatively easy to 
make. Alternatives were clear, and ^^hoices were few. 

In the decade following Worid War 11, the web became 
more complex. As the span of its concern^ widened, the state 
assumed a larger role in the daily lives of its citizens. Increas- 
ingly, govemmcnt regulated, subsidized, controlled, policed, 
and concerned itself with tl'tC welfare of its citizens. The 
govemmcnt assunned responsibility for the aged, the indigent, 
the physically and mentally ill. Populations grew exponentially. 
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The clamor for free or low'Cost quality cducaUon cxtcnJcJ 
downward to kindetgancn and upward to the graduate sehooL 
Society increased its dependence on a technotogicat base whkh 
demanded a high level of eJuv^ation and extensive re^arch 
capabilities. Universities expanded and multiplied, lleacher 
kodegC!^ became universities. Graduate programs prolifer^ed. 

As state budgets became larger in response to neur and 
more substantial JemarhUi the old ways of delennining the 
allucatioa of money were rendered outmoded and inackt|Udte, 
State legislatures MJiight improved ways of corKeptuali'ting 
and addressir^ the ^untroversial questions with which they 
were confronted. They sought to deal broadly with the ques- 
tions offilJocation of additional support among categories Sii>^h 
as mental health, roads, and education. Within the latter cate^ 
gory^ the proper balance, aiuong fundir^ of kinder;garteti, edu- 
^atiun for the handicapped, and gr^umv^ ^nd rcseaivh pivt,4ims 
became the focus of decisions. No loniger could the legislature 
deal with the welter of tonflitting data and frequently incon^ 
sistent v^ldims prc^^nted by a larger number of indiv,dual and 
ambitious universities. The division of money among iini- 
vcrsities. becarne buned in Jaiger questions. Political rather 
than educationat considerations govemed hasty and of^en un- 
mfofmed decisions with respect to the division of money 
among the plethora of uruversity petitioners. Planning to av^- 
commodale the future was uncoordinated, parochial* or non- 
existent. Yet the problem of expansion was the greatest single 
problem faeing higher education. 

The states responded by designating to a single agency 
responsibility for the planning and coordination of higher 
education. The legislature was thereby able to deal vtiih the 
broader conceptual questions of the division of resources be^ 
tween public education and higher education and proper 
allocation of Mate revenue to each of the:^ functions. Boards 
were given authority to rev.omniend the establishment uf new 
institutions and the expansion of existing ortes and to plan fot 
die distribution of students and ptpgrams among the institutions. 
The outcome of the struggle between those who feared en ^ 
croachrttent by ^uch bourds iipoa traditional institutional aufon^ 
omy and those who believed in ihe necessity forsu^h timfKation 
was staTe boards with vaned diities and responsibilities, Siich 
boards range from (.oordinating bodies po^ssmg rev^ommend^ 
ing authority only to single goveming boards controlling a 
consolidated budget for all publicly supported iiniversities. 
Since mid J950, however, the trend has bcea clear and iinmts^ 
takable, states without such central authorities esiabhshed 
them, and those with ^eniral boards strengihened iheir powers. 
At the present time, 47 states have central boards as contrasted 
with 17 in 1954, 

Clark Kerr, in a foreword to the Carnegie Commission 
report on governance, U^ted the advantages of the L;ntral 
office as follows: 

J, It concentrates certain extemal relations, particularly 
with state and federal authorities, in i single office where they 
can usually be better perfonned, 

2. ft facilitates lor^^range and overaH planning of the 
creation of new places for students, of the provision of new 
services to new areas of the state, of the assignment of new 
endeavors among campuses, and of the continuing difTerentid^ 
tton of functions between and among campuses, 

3. It makes possible (although by no means certain) the 
detennination of diversity among campuses, as v^ompated with 
the stfindardization that results from their ujmpetitive limitation 
of each other in the absence of central policy. Diversity is 
.more likely to flow from central authority than from local 

^ autonomy. 

4. It facdttatcs greatly the creation of new campuses, ^nd. 



some of the most innovative have tome from within multi 
eampus systems, 

5. It encourages better managemcnti with the aid of 
specialists in the central administration and the exchange of 
experiences among campuses. 

The disadvantages of such offices have been pointed out 
by Dr, Fields. They result in slower decisions, the process of 
decision making is more cumbersome* and they are frequently 
out of touch with the campus and the current practicalities of 
relationships. The process of centralized plannir^ has inherent 
in it the frustrations of the aspirations and hopes of some. That 
is to say, to pennit a Jaw college to be established in one 
university is to deny a law college to X other Universities 
Centralized offices encourage the production of paper, and 
their rules and regulations — which are designed to cover 
aveOiges — stultif> the extrenies which normally represent ex 
perimentation and creativity. Perhaps one advaatage is that 
they, shift the ire of faculty from the local administration. 
Indeed, a wise central administrator discusses with local P^i 
dents whether responsibility for an unpopular decision shoUd 
be assunied by the local or the central administrator. 

Dr, Fields noted that many of the problems of ccntraliza 
tion stem not so much froro the centralization of higher educa 
tion as from the increasing centralization of government. Rules 
regarding classification and payment of personnel, rules re 
garding the siting of buildings and roads, rules regarding 
disposition of revenue, rules regarding the purchase of equip* 
ment, rules regarding the employment of minorities, rules 
regarding the equalization of women's salanes^-all of thc^se 
stem not from the state higher education authority but from 
other stale or federal agencies. If my own experience is typical, 
such rule^are frequently made by other stale agencia^over the 
' igorous objection of the higher education agency. These slate 
and federal agencies, in tum, represent :;octety's response to 
the growing interdependence and the complexities df our lives 
Whea population density was much less, it made little dif 
ference hpw >ou disposed of your refuse. When universities 
were relatively small, with few employees, and the state itself 
^^^hofa mj^Qj employer, personnel policies could be handled 
on a departniental or college level. The impact of a decision 
was minor. .Now the state payroll is such that unifonn policies 
with respect to pay are essential, as they are in any large 
organization, public or private. Finally , we have come to use 
govemment as a mechanism for achieving social goals A 
detennination of whether those goals are being realized and 
whether the various beneficiaries of slate and federal provi 
dcnce adhere to public policies demands an overabundance of 
reports, 

in summary, the cry against centralization is in part a 
protest against the restrictions required to enable man to 11^ e 
with man on this increasingly densely populated globe, in part 
a protest against the restrictions upon our freedom involved in 
achieving the social goals i^hkh the interdependence and 
humaaity of maa and the w(^lmire of a democracy render 
essentjaU and m part a protest agaidst the restrictions which 
accompany the allocation of limited resourees. We do not 
easily concede that **big daddy" knows best, 

I mean by this to place in perspective the outcry^against 
controls imposed by a central higher education authority. Who 
among us has not witnessed that aJI-too human tendency to 
rebel against any authority? Rebellions on a university campus 
sometimes manifest themselves in the attempts by professional 
schools, such as law and enginecringi to free themselves from 
the controls of the universtty, Tlie **wc are different" cry can 
be used not only by the president of the university against a 
higher authority but by segments of the university agahist the 
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authority of the univeisit> itself And who h to sa> that the 
ruIcK imposed by a university bureaucracy which controls a 
carnpUK of 30.000 students (a sizeable city not too man> 
;cadeK ago) are any more responsive to the tndtvidual needs 
of faculty or departments than the rules imposed by a central 
body responsible for 20 universities and 2^0,000 students? Is 
ont* more remote than another? In our cries for indcpen<]cncct 
arc we not harkenin^ back to a longing for days thai were and 
that cannot be recaptured? 

To place a trend perspective is not to endorse all the 
details avtd excesses. The excess of centralized managenfient 
may stifle the creativity which is the ultimate achicvenfient of 
higher education When [ was in Russia several years agOt 1 
received an impression of enormous expenditure of human 
energy and time just lo enable the system to work. So much 
enengy was consunted by the operation of the system that little 
remained for accomplishing productive tasks. 

A faculty consists of individuals who are professionals. 
They insists and properly so from thetf viewpoints on having a 
major role in decision making which affects their professional 
activities Many of them are surprised* and of^cn annoyed^ to 
find^that they operate within a lar^ge administrative structure 
which must establish rules ii\ order to function. They' are in a 
^nse entrepreneurs witii a close personal relationship with the 
students Hence, it not Surprising to find impatience with 
restraints necessary to operate a large institution and an abiding 
5ense of distrust of those who would interfcreinany way with 
the free How of events The govemancc structure^ whether at 
the university or central state office, must take into account the 
atomistic nature ofunivcrsities and the true seat of authority. Jt 
is interesting that the faculty reaction to increasing centraliza- 
tion has been to seek relief by oiganizing through unionization. 
The collective nature of the resulting organization is contradic- 
tory to the atomistic nature of faculty decision making. The 
goal is to pit one large organtzatton, the union, against what- 
ever large organization thwarts the union's goals. The resulting 



concentration of power pib the tips of scrvcra) large pyramids 
against each other and nnay well result in csvalatmg the central- 
ization* the diminution of which may have prompted the 
union's being* 

M> conclusion is that the balance vt forces point to 
continuing^ and perhaps even more» centra I tzation* We tend 
more and more to look to the govemment as the guarantorr or 
at least the preserver of the good life. The humanists^ for 
example* recently suggested the government had an obligation 
to provide appropriate jobs for Ph.D. s in humanities, i did 
hear much scoflfing at this idea in ihts, the ZOlst year of oitr 
country. But to think that the government would then 
regulate salanes^ dictate tasks» and finally regulate the supply 
is — well. tl<^ kindest word i can use is ''naive.*' 

Centralization will probably continue and even grow. Do 
we accept this and retreats grumbling* to our enclaves? Not at 
all. Vigorous debates should center about goals and the most 
effective way to achieve those goals. For example^ only a 
cenira} agency can assure thatarational plan exists for extending 
educational opportunities over a wide geographical area with , 
maximum access. On the other hand, although only the central 
agencies cap assure that enough, but not too many , engineering 
programs are offered in a certain arca» such an agency cannot 
and should not concern itself with the details of such engineer- 
ing progfarris. While the central agency can and should make 
decisions with respect to the allocation of resources^ it should 
not control the utilization of ^osc resources within the uni* 
v^tty until the university attempts to thwart a prohibition by 
offering a forbidden program. 1 agree with Dr. Fields that there 
is no debate over the extremes* There ts and must be a con- 
tinued and lively debate over the range between those extremes. 
Reasonable men can differ on specifics* but no reasonable man 
can differ on the axiom that no inherent virtue exists in 
adherence to a philosophy that* on any given specific issue, 
centralization is automatically gutx! or automatically uvil. 
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institutional research (IR) offices always have played a 
role in planning thiough the conduct of Uaditional functions 
such as [Ejecting enioHments, counting students* faculty and 
staff* anJ studyiiyg attrition. The results of dtcse efforts have 
provided the basis, either dUectly or indirectly, for planning 
conducted in higher educattOD institutions. Within dte last ten 
years, as the:Nat]onaf Center for Higher Education Management 
Systems (NCHEMS) has made itself known throughout the 
countiy and accotmtabiitty has become the favorite word of 
state boards, IR offuxs have become increasingly invoK-ed in 
planning activities. Most such offices have accepted these new 
responsibilities as pait of their regular work load, utilizing 
whatever human resources are available. 

During the next decade* however* if planning is to pla^ a 
m^jdrrolein higher education institutions^ institutional research 
offices must be stafffcd w ith the appropriate level of expertise lo 
support this eftbrt. Therefore, mastagers of those offices must 
take a hard lock at the demands these future conditions will 
impose and plan accordingly. How will an expanded role h 
planning affect institutional research operations? What functions 
will IR offices be expected to peiform? What wilt it niean in 
terms of personnel requirements and priorities? What organiza- 
tional structure will best serve institutional research needs? 
The following is one perspective on the issues which are likely 
to confront managers of institutional research offices. 

Role and Functfons 

Conceptuajjiy> institutional research otficeswill beexpccted 
to pedbrm four m^forfunctions: ( I), data exchange, (?) account- 
ability reporting, (3) analytical studies* and (4) planning. 

Data exchaiige. This function includes collecting data and 
reporting it to various external agencies including federal and 
state governments, professional associations, and directories, 
Tbe data axc^ intended f^H' purposes of assessing the pe^orinanoe 
of agtven institution, but ratheras more generalized descriptive 
'information about the institution. While this has been a traditional 
function oflRoffices, the trend overthe last five yearsindicates 
that there wilt be a substantial increase in t>oth the amount and 
detail of data requested, institutions will have no choice but to 
severely limit reporting they are not compelled lo do. and hard 
decisions will have to be made concerning whfch of dte so- 
called non-com pulsofy requests will continue to he answered. 
As costs, and demands escalate, it will become necessary lo 
carefully curtail the amount of resources expended to support 
this function, 

Aocounlablllty reporting. This traditional instttutionat re- 
search function hasexpanded rapidly over the last fewyears. As 
tesoutces have bec<$hwtTK>re limited, federal and state tegtsladve 
bodies have increased their de;:!^ds for far greater amounts of 
detailed daacoooenting die perfonnance of indivifi^ual institmtons. 
While, traditionally, instittitions receiving public fijnds have 
provided information lo their various sponsors, in recent years 
there hasbeenanexpdmniial increase in the anKHint and type of 
data required. At the state level, many institutions which 



typically provided input*output types of data such ai aggregate 
costs, numbers of faculty* support staff* students enrolled^ and 
graduates, aie now being asked to provide detailed information 
on class size« faculty work load, programmatic ccsting* and 
afHrmative actbnpfactioes. While some individuals, partlctilarly 
thos^ repcesenting sponsoring agencies* will take the position 
that these new requests for data represent a higher level of 
sophistication, from the institutional research vantage point it 
would appearthat tliese^^uests involve primaiilyan increase in 
thearray of mtio data being produced that are ahnost impossible 
to interpret inany meaningfut.way. While NCHBMS has made 
some pn)gress in standardizing definitions, many agencies and - 
institution^ are still struggling to produce requested data that 
can be understood and intelligently used. For example, in 
Pennsylvania, die fourconmionwealth universities* afkrayear 
of workf have not yet agreed on a common methodology for 
determining instiucttdnal level; thcrefiwe, two different meftods 
are used, with the state accepting the cost data as though 
they arc comparable. Though accountability reporting is fraught 
with problems, only the initial phase of such demands is 
currently being experienced. To a large extent* tl^ current 
activities can be defined as the number manipulation activities 
which, given sufficient time, can be performed. The future 
information gathering will not involve efftdency measuring of 
institutional operation, but will examine ef^xrtiveness of the 
institution, a quality much more difficuh, if not impossible, to 
measure. As competition for public f^ds becomes more iruenser 
all institutions of higher education will be confronted with an 
increased number of reqt^s to prove that institutional per^ 
formance is equal to the investment, 

Anatytfc^ studies^ University administrators have tradi- 
tionally looked to institutional research offices to provide 
specialized studies lo support management decisionmaking 
functions. En die future, there will be an increased need to 
provide appropriate information to institutional manaS^^nt in 
those areas directly associated wiih msource allocation. While 
offices still will be asked to conduct studies in such areas as 
grade-inflation, this type of study will, of necessity, assume a 
lower priority. Much more critical to the institution wilt be 
information to support management decision making; in the^a 
of resource allocation « POr example* it will increasingly become 
the function of the IR office to examine proposals u> initiate or 
terminate programs. These examinations will take into account 
student demand. Impact of [^g^ams on other departments or 
schools, faculty requirements, cost effectiveness in tenns of 
both implementation and operation, and pbysfcat facilities 
requirements^ Performing analytical studies will mquire thetise 
of modeling techniques to ascertain the impact of selected 
actions over time and the effects of various policy alternatives 
that are available to institutional managers. 

Planning. Planning support activities comprise the final 
function that institutional researdt offices will be expected to 
perform in the future. Whether or not the institution has a 
formally designed planning office, institutional research will 
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play an integral role in support of planning dctivities. fn both 
operational and developmentalplanning, i.e., the one- year and 
five-year planning modes, institutional research will continue 
to be re&ponsjble for providing analytital studies* enrollment 
projectionst and a quantitative reporting stnicture for intemal 
deeisiDit making, as well as managing central data banks to 
support evaluation aetivJttes. The major challenge facing an 
office of instituuonaJ research will be its involvement in long^ 
rang ot strategic planning. Institutions will, of necessity, have 
to make forecasts not in terms of a two-, three-, or five-year 
time frame, but in teims of a fifteen- to twenty-year time 
frame. The IR offices will be asked id assess potential markets, 
idenhfy new methods of delivering services to these maikets, 
examine the demand and supply of students in terms of occu- 
pations and manpower requirements, and assess the impact of 
these programs on the institution on a loog-tenn basis. In 
addition* IR O0ices wtlJ be expected to predtct funding patterns 
and estimate futum income. Of panJcuIar importance will be 
the ability of institutional research to assist management in 
interpreting data obtained through various forecasting method- 
ologies such as morphological, scenario^ force analysis, con- 
tcxual mapping, simulation, matrix, dclphi, and others. 

A majOr distinction between the activities involved in 
strategic planning as opposed 10 activities currently or tradi- 
tionally being conducted by institutional research offices is the 
nature of the data that will be utilized. A shili in attention from 
quantitative data to qualitative data involving societal values, 
expectations, and needs is required. Most in^rtantly* ibe 
traditional analytical skills now mnstbecombii^ with synthesis 
skflls, that IS. the ability to bring together diverse sources of 
quantitativeand qualitative information, bringing new meaning 
and interpretation to highly uncertain data while always recog- 
nizing the nsk associated with decision making. It will be the 
pnmary function of institutional research to provide tite expertise 
to reduce to whatever extent possible the entropy associated 
with policy decisions. It ts the unique speculative chaFacteristics 
of the data,, and the need to synthesize, that will produce the 
greatest challenge in the'coming years to IR offices. 

Personnel Requirements 

On the assumption that the above four functions will 
represent the generic activities to be conducted by an office of 
institutional research in the future, it is essential that car&ful 
considerutton be given to the personnel who are selected to 
perfofm these functions. During the next five to ten years, it is 
hypothesized that fR offices will have access to a larger array 
of data bases containing reliable and valid data that can be 
manipulated to provide base line data conceming institutional 
operations. As this occurs, there will be ^ concomitant shift in 
staffing pattems. Individuals who are currently performing 
clencal-type activities will be replaced by information specialists 
who can relate data needs to the people who operate the 
computer system and then synthesize the data to provide , 
infofmation required by administrators. Although many IR 
offices arc cunently staffed by individuals who are trained m 
economics, demography, statistics, computer programming, 
and systems management, it ts evident that ifinstitutionsaie to 
move into such areas as marketing and strutegic planning there 
will b^/ptn increased premium on these skills, additionally 
requiring the ability to apply these skills to the areas of higher 
education* Mint-modeltng activities will become increasingly 
important and there will be increasing (bpendencc on inter- 
active computer systems. 

While technical skills will continue to be of importance, 
the higher level of nccessao cognitive abilities will bring about 
major changes in personnel type. Individuals of high initiative 
who possess the ability to analyze problem situations and to 



fonnulate and r^nunend policies that can improve institutional 
operations will be required. It is important to i^^gnize that by 
engaging in the four functional areas, IR offices will be in a 
uniqtie position to have an institution wide perspective that is 
unavailable toany other area of the organization It is essential, 
therefore* that as a staff office to university administrators 
institutional research offices fulfill ihis role by continually 
responding to targets of opportunity, recommending changes 
that have institution- wide consequences, and not waiting until 
ad assignment h given or until somebody asks for a specific 
piece of datum. 

Directors of IR offices will be required to have a much 
broader perspective in terms of institutional environment They 
will have to be not only aware of, but able tounderstand and be 
in agreement with, the value systems of the acackmic mission and 
the character of the institution, at the same time maintaining a 
high level of objecitvity. in the final analysis, the success of 
each IR office will be detennined by the degree to which it is 
able to support and interact with the various life-styles, values, 
and beliefs of the faculty who are performing the primary 
missions of the institution. Without this understanding, IR 
offices will be viewed with increasing suspicion, particularly in 
the areas of policy formulation and strategic planning, and their 
usefulness as supporting staff to the management team of the 
institutions will be greatly reduced, if not completely abrogated 

Staff menibers will be needed who possess a high level of 
professional activity coupled with an awareness of both the 
intemal and external environment A major issue facing directors 
of institutional research offices is how to obtain this type of 
staff. Dotheysimplydismissexisting people who don'tcimtntly 
have the required skills and competitively seek on aregional or 
national basis the best people available? What are theiroptions? 
Although directors should, seek to fill new positions or make 
replacements with individuals^o do possess hj^er levels or 
skills than are currently available, they now must develop 
syste matic 1 n-housb uain ing programs providing job expansion 
opportunities, extemaJ professional training, and fonnalized 
course wotk offered by their own iristitutions. Too often, the 
developmentofcurrent staff is less than systemalically addressed. 
Directors ease their consciences by sending their staffs to such 
placesas the NCHEMSwofkshopsand other conferences. This 
hit-pr-miss approach does not meet the needs. The Association 
for Institutional Resean^h (AlB) shoufd not only expand its 
workshops to include topics suitable for the more sophisticated 
staff and of fer them moie frequently than once a year, but it 
should also develop a more professionally oriented, integrated 
se^^uence of learning experiences to provide for fhc develop* 
ment ofits membership. The AIR could drawon the expertise of 
its membership and experts at institulioiis across the country to 
assist in this task. This cotild be of invaluable service to the 
membership of AIR and to the institutions to whkh the members 
belong. 

Finally, in terms of personnel utilization, as staff expertise 
increases there will be a concomit^t Increase in staff costs 
Since relatively few institutions will be in apostlon to employ 
the total array of talent necessary tc meet the requirements that 
arc envisioned by the fourareasof operation, altematives must 
be sought that can provide resource expertise as requirements 
demand. There arc at least three options available that can be 
cost effective. 

The first of these is the utilization of in-housc consultants 
That is. the utilization of existing faculty within each institution 
who have the particular expertise r^uired. For example, moist 
mathematics depaiimcnts have faculty vfho have expertise in 
th? area of statistical analysis; computer science dcpanmcnts 
can provide assistance in the structuring of data bases and 
infofmation retrieval systems; and many faculty in the social 

22 



Brown and Yeager 



sciences have extensive experience in the design of survey 
insiruments and the colleetion and analysis of that type of data, 
A vailabfe at most instilutjons arc demographers and economists* 
as well as operations research and higher education specialists 
who ean provide on a shon^term basis a high leveJ of expertise. 
AJthough some offtces currently utilize these services, it is 
Jikely that these internal types of arrangentents wilJ expand 
during the coming years. 

Second, and perhaps to a more limited extent, JR offices 
may find it more cost effective to employ outside consultants for 
particular types of scrviees, both in consultative advisory roles 
and in actuaJ siiKontract arrangements. ITils option would 
provide expertise with no continual commitment of f\inds, 

Fmally» an altemative that may merit some degree of 
attention isthe establishment of in foFnial information exchange 
mechanisms by AIR, QftcTi, a great deal of time and. effort is 
spent in reinventing the wheel simply because there is no ready 
access to colleagues who are working in similar areas. It might 
be p^ible to develop some special interest groups within AIR 
thateould serve as a resource for the exchange of information in 
specialized areas. 

Organization and Management of iR Activities 

As offices of instttutional research become moie heavilty 
involved in the support of management decision making either 
through the function of analytical studies or planning^ it will 
become important for these offices to repon at a high level 
within the organization^ preferably to the chief executive officer. 
This will pcfmit more direct lines of communication in the staff 
support scrviees that the office is to provide the institution^ as 
well as facilitate the office's work in gaining cooidinatkm and 
cooperation with all areas within the institution. As resource 
management gains increased attention by ehi'ef administrators, 
appropriate linkages and relationships will have to be developed 
with other ofTtces such as budget and computer services, as well 
as with the ehief academic ofTinces of the institution. 

Of major importance to ttie director of an IR office will be 
the internal organization and management of the offtco itself. 
Again, assut^ing that the four m:yor functions previously 
discussed are valid, and also'iassuming that personnel will be 
avail^le whoeanbceharaclcrizedas innovative experts in their 
ftcldst it wilt be necessary to organizeboth the activities and the 
personnel insuch a manner as to maximize the productivity and 
performance of the office and ^t the same time provide a work 
environment that is supportive of the individual staff personnel 
and promotes their professional growth. 

While recognizing that there is no single atiswer as to how 
an institutional research office should be organized and managed^ 
there are several issuesthat need to be adilresscd in considering 
the IR office of the ft^mre. For example, ail four functions to 
sotrK; extent share common data bases, yet each has unique 
requirements that differ from function to function. To provide 
common dat^. should a data manager position be established 
that is responsible for retrieving data from computerized systems 
to meet these common needs, ur should personnel be organized 
around the four functions^ each having its own information 
retrieval personnel? If personnel arc organized around functional 
areas, will there be a redundancy and underutflization of 
expertise, or will a maldistribution of expertise exist? Can a 
' functional organizational structure provide for opportunities 
and job expansion that will permit individuals to achieve some 



degree of professional upward mobility? How can one handle 
special projects that cut across all four functional areas? How 
does an office maintain a working knowledge of what's going 
on in the several divisions and schools within the institution 
andf at the same time, keep abreast of ncwchanges taking place 
nationally in specific areas of professional expertise? While 
there is no existing prescription for the resolution of these 
problems^ the possible benefits that could be derived from the 
implententationofa modified matrix organizational structure or 
team approach should beconsidcred, Thh type of structure may 
not be appropriate for small groups of fewer than ten to twelve 
individuals, but it does have advantages \j} terms of creating an 
appropriate work environment for ]af]ger groups. One might 
conceptualize having individual staff assigned to various cells 
in a matrix with the horizontal dimension being functional areas 
and the vertical dimension being based on specific skills such as 
infofmation retrieval* analysis or statistics, data collection, 
report preparation, and so on. An altemative might be to have 
the vertical dimension representing broad areas within the 
institution* thereby facilitating the working knowledge of these 
areas. Although there would be difficulties in managing such 
a structure, one beneftrthat might be derived is that individuals 
would have more than a singular responsibility, therefore 
pcfmitting some degree of flexibility in assignment as well as 
professional development, 

Issues 

While specific solutiunsto issues ooncemingthe operating 
functions of the Office of Institutional {Research of the future 
ean not be offered, someof the major issues that each IR director 
will likely have to address are summarized below: 

1, With the increase in requests for data^ both for data 
exchange and for accountability » how ean IR offices more 
effectively respond to these requcsts^nd what criteria should be 
established for determining Uie degree to which they should 
respond to these requests? How can the efficiency of their 
responses be maximized^ thereby minimizing Uie number of 
responses? 

2, Assuming Uiat 11^ offices will require incn^ased staff 
expertise, how can additional training and experience be provided 
toexistingstaff which will facilitate their professional develop- 
ment? What should be the role of AIR in these activities? 

3, To what extent is it possible to supplement theeapabilLties 
of IR offices through the use of both imemal and external con- 
sultants? How should these amutgemcnts be made, and can they 
be afforded? 

4, What alternatives exist for origanizing and structuring 
IR offices insuch a manner as to providea working environment 
that is conducive to maximizing the individual potential and 
expertise of the staff? 

While recognizing that there will be many factors that must 
be considered based upon individual eiicumstanccs, the greatest 
challenge facing the director of an institutional research office 
will be to identify the right combination of expertise and 
personalities and to mold them into an effective force for 
corttrihuting in an innovative way to the sohition of college and 
university problems, both prc^nt and future. If these challenges 
are to be met successfully^ innovative management strategics 
that will facilitate the management of institutional research 
offices will have to be developed. 
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The Report Quandary 

As an institution of higher educarion gn>ws in number of 
pmgrams and affiltations, there is aUo an increasing number of 
nationaJ, state, and regional agencies and Ofganizations ex- 
pressing interest in knowing aboin the operation of the institu- 
tion. While tnany of these interests relate to program evalu- 
ation by professional discipline groups, others are of a com- 
parative nature. In many cases, the information furnished 
is ultimaiely published in widely circulated doctunents, often 
becoming the basis for peer comparisons and professional 
evaluations. 

With the increasing number of respondents providing 
information to outside users, there also exists an increasing 
potential for embarassment when reports leave the institution 
reflecting facts that are grossly dtflkrem. While some queries 
regarding faculty distribution, salaries, and credentials are 
addressed to the chief academic officer, others arc addressed to 
the tlnance officer, the institutional research officer, or the 
librarian* It Is tK>t an easy ntatter ^ determine what offices 
througliout th< institution receive queries and how these of- 
fices, in their own ways, respond to them. An institutional 
research office frequently hears about surveys and question- 
naires when a secretary from another office telephones to 
search for needed infonnation or to ask how particular questions 
should be answered in situations where available data is defined 
difft^ntly from that requested, ft ts likely that ntany items that 
leave the institution purporting to be official data come from 
attempts to gather piecemeal facts using unofficial definitions 
or look-^good interpietations. ft stands to leason that the validity 
of the institution's official records will soon be doubled as 
more and more inconsistent^ and sometimes contradictory, 
data ^ distributed in this decentralized manner. 

Although an office of institutional lesearchXrequentlyhas 
no explicit authority to create or maintain any of the official 
data files of the institution, the performance of instittxional 
research inereasinglyputs this kind of office in a position to be 
held accountable for such files as well as to become increasingly 
enmeshed in an interpretive role. Probably much more fre- 
quently than one realizes, this kind of office receives reqi<ests 
to provide a variety of information to users both inside and 
outside the institution. While these requests may be in the 
form of memos, letters, or questionnaires* they are most often 
received informally by telephone or a walk^in visit. Requests 
are received from all levels of personnel rartging from the 
ambitious, inquisitive student searching (ot class prpjcct data* 
through secretaries, administrative assistants, senior administia- 
tive officers, and the institutional president. Apparently, the 
institutional resea'^h office js seen by its numerous customers, 
particularly high echelon administrators, as a place where 
infonnation and procedures appropriate lo interpreting the 
institution's^in formation arc available on a moment's notice. 
Consequently* there is ample reason for an instittitional research 
staff to become uneasy when asked to report and interpret data 
using nunfierous informal sources where definitions can be 
established only through trial and error. 



The Ctearingbouse Function 

Without appropriate recognition and administrative charge, 
an institutional research office often functions to a great extent 
as aquasi-offtcial clearinghouse for large amounts of quanti- 
tative information leaving th^ it^titutton. Having recognized 
and assumed this clearinghouse role, the institutional research 
office has placed itself in the position where others, both 
originators and recipients of the data,^are prone to see it as 
responsible and accountable for materials passing through its 
hands. To some degree, this function has put the institutional 
research office in a position to work closely with other offices, 
where data are generated and maintained, in efforts to establish 
consistent definitions and us^e of basic information. 

A case in point is the data relative to staff personnel 
usually collected and tnaintained in the institution's personnel 
office. At Georgia State University, efforts have been made 
between the personnel office ^d the institutional research 
office U) <i[^velop consistent and accurate data about staff and. 
faculty personnel. This joint effbrt has been quite productive, 
and today, a variety ofregularuses can be made of information 
residing on the personnel office data files. This cooperative 
effort toward standardi2ing defmitions and us^e has pro> 
duced a substantial payoff in the area of institutional studies 
about staff and faculty personnel. It is unfortunate that in- 
formation on faculty is not so readily standardized as that on 
staff personnel. Consequently, when inconsistent definitions 
of information pertaining to personnel holding faculty rank 
exist, data cannot be utilized to the desired extent. 

It is in an instance like this, where inconsistent definitions 
and erroneous use of data are apt to cause frequent and gross 
distortions* that the clearin^ouse role acquires greater di- 
mensions. It then becomes necessary for tl^ institutional re- 
search office to deal with data in ways inconsistent with basic 
concepts of good management and often demanding that sub- 
jective decisions be made without benefit of all the facts. 
Again, it must be emphasized that an office of institutional 
research, although frequently thought of as an information 
storehouse, remains in actuality an information clearinghouse. 

While the institutional research office is not usually re- 
sponsible for the generation or maintenance of any official 
institutional data base, it regularly needs to use information 
from data files of various Q^(e.g., the personnel file, sttident 
records file* budget file, cunriculum file, and payroll file). 
Because of its fatniliarity with the Interdependent relationships 
in the data, the institutional research office can spot occasional 
problems in the data and can work whh appropriate administra- 
tive ar^as m a quasi role toward preventing release or publica- 
tion of inaccurate information, fn these cases, the additional 
function of content inK)nltonng is sometimes coupled with 
content correction in the clearinghouse context. Although the 
institutional research office in my institution has gained, through 
experience, the knowled^ to petmit minimum monitoring of 
data for accuracy, it is imj;^ctical to expect this office totalce 
on the task, voluntarily rrothcrwise^ of originating, maintain- 
ing4 or correcting any cfficial institutional files. Yct^ out of 
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cOurtc^>, my office has made a pracuce of infofming areas 
responsible for the malntenanco of data when obvious errors 
are observed. Generally thes^ gestures have been positively 
received and encouraged. 

Data Definltlom 

There 3ie other vital areas related <o these problems where 
an institutional research office can meet the challenge, A 
significant lack within the nunterous lecoid-keeping endeavors 
of most academic institutions is an institution-wide standard 
for data definition and utilization. The puiposes of such a 
function arc many. For example, when salaiy is mentioned- 
any number of meanings can be assumed depending upon the 
circumstances and interests. If a leaching faculty member's 
salaiy is in question, there arc numerous options. Is it for the 
academic year? Is it for the fiscal year? E>oes it include sup- 
plemental remuneration? Does it include summer school re- 
muneration? Does It include flinds from grants? Does it include 
fringe benefits? Is the amount expressed as an hourly wage, a 
monthly salaiy, a quarterly safaiy. a per course salaiy. an 
academic year equivalent, or as an annual equivalent? These 
are representative of the type of questions that must be asked 
and answered about evcr\ item^of data utilized in compiling 
information. With an ope tional data definition and utilization 
proceduref an item like ^^zry would be consistently defined 
and utilized throughout the various areas where Jt is stored and 
used, frequently, salaiy data is stored differently in v^ous 
locations because one user needs total remuneration, another 
needs annual state monies alone, while still another needs 
equivalent academic year based only upon state funds. This 
ever-present increasing ""hodgepodge" creates the very en- 
vironment where nobody knows what anybody is doing and 
errors arc bom, nurtured and multiplied. In thb context, eventual 
misrepresentation is a virtual certainty. Comparisons of dis- 
parate data coming from two differcnt sources will obviously 
arouse suspicion as to the validity of any of the data or the 
honesty of the data reporter. 

Data Base Manager 

Several years ago, computer systems managers in many 
corporate structure perceived a collision course cxistii^ where 
rn^or management decisions were being formed on the leasts 
of inconsistently defined information. The need to monitor 
basic data definitions and specifications became even morc 
acute as corporations began to recognize the interdependence 
of many of the depa/tmental data bases previously thought to 
be the private domain of each individual operating con^nent 
of the corporation. From the observation that all these separate 
little empires werc related at some level giew the concept of 
linking the previously disjointed data to provide more timely 
and comprdiensive management decision infonnation. The 
management infonnation system concept can thus be regarded 
as a practical attempt to incorporate general systems theory 
into the process of handling large amounts of detailed infomib- 
tion so that it b meaningful when summ^asod for critical 
upper level management decisions. The function of the data 
base manager developed out of the need for data file elements 
to be adequately defined and documented at the time of systems 
design and implementation. This function, while not responsi- 
ble for t)u accuracy of the individual bits and pieces of 
infonnation, does have a continuing responsibility to monitor 
the mechanics and procedures of information storage and utili- 
zation-Otherwise, the type of data stored in a given field at 
any oite point ^n tunc may differ gieatly from that stored at 
another time, with the ultimate user never having any know- 
ledge of the chaise in practice. The functipn of a data base 
manager is all the morc important in situations in which data 



users have tittle or no input into the structure of the data and its 
initial gathering and storage. 

It would seem appropriate that stronger support be afforded 
the function Of data base manager in educational institutions. 
In some institutions, where therc is recognition that all the 
official files of the university arc related and interdependent, 
this function is in the hands of an institution- wide committee, 
with the chief executive officer or similar high echelon ad- 
ministrator as chairperson. Before new data files arc added, 
their use must he ade<iuately defined andjustified. And. before 
definitions and utilization of any data files arc amended, therc 
must be full exploration of the effect of the change upon all 
the users, Topennit this kind of tracking in the use of specifK; 
items of data, a data base manager must maintain a closely 
controlled cross-rcfercncing procedure most oUcn called a 
"data element dictionary," The National Center for Education 
Management Systems (NCKEMS) has for several years sup- 
posed the .concept of maintaining a data element dictionaiy 
and, consequently, provides a trcmendous amount of technical 
support to jrnplement such procedurcs within educational insti- 
tutions. In addition to providing guidelines for consistent use 
of data fields, the djata clement dictionary indicates where 
specific kinds of data aie available and it^ntifies all the regular 
users of any piece of data. With this kind of procedure, no user 
finds himself suddenly without necessary operational data. 
Another great benefit from such cooperative monitoring efforts 
is that duplicate and unnecessary data gathering and storage 
can be eliminated, resulting in substantial monetary savuigs in 
bo.th labor and computing machinery. 

Considerations and Suggestions 

While it is not the purpose of this paper to suggest that the 
institutional rcsearch office should assume rcsponsibility for 
all reports prcparcd and departing from the institution, it is. 
however, envisioned that one frequently observed function of 
this office might be further developed and supported — that of 
being a clearinghouse for information destined for both in- 
ternal and external utilization, A further suggestion is that this 
clearinghouse function needs to be morc closely aligned with 
the function of the institution's data base manager in efforts to 
guarantee consistent definition and appropriate use of individual 
pieces of data, Thisjoint effort would consider both the source 
and the ultimate use of data from the time the need for data is 
first recognized, through the process of designing computer 
programs for storing the data, and lo ^ point wherc end- 
product rcports arc delivered and used. 

Another probable responsibility of this function would be 
to serve as a clearinghouse for all queries received in the 
institution. These infonnation requests arc usually addressed 
to a variety of offices on the campus. What is reported and to 
whom Is anybody's guess. It would appear that a satisfactory 
solution to this growing problem would be to have all external 
requests for infonnation come to a central point, be logged, 
farmed out for necessary data where needed, but rctumed to 
the central rccording point before the response is mailed, It is 
not unusual> for example^ for two entities within an institution 
to spend hours of manpower and many dollars worth of com- 
puting time responding to duplicate requests from the same 
external office. When two requests arc mailed lo two diflforcnt 
offices within an institution and thcie is no ctearinghouse 
function for such requests, neither office can know of the 
other's involvement, and both m^ rcspond in their separate 
aDjJ differcnt ways, Therc is no way to estimate just how 
much time and money is spent preparing data, if not duplicate 
requests, for similar information. 

These considerations indicate a need for support in direc 
tions which would further define an information clearinghouse 
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runction within the office of institutional research and toward 
formal atigrnnent between this clearinghouse function and the 
institution's data base manager function. But the sensitivity of 
these suggestions cannot be overlooked* for precedent* some- 
times of necessity* has long bi^en sei. In most institutions, it is 
frequently felt desirable to operate on a completely ind^pen<lent 
basis; administrative areas aie long accustomed to defining 
their data systems to store just that data they presume necessary 
and then freely changing data definition^ their own individual 
needs change Efforts to establish a clearinghouse function aixl 
to align it with that of the data base manager could appear 
threatening if not provided the full support of upper level 
administration Even minimal efforts to channel all informa- 



tion requests through the institutional research office could be 
met with disdain were upper echelon support denied. " 

This paper, while not intended to pteser t a detailed pteture 
of possible solutions* is concemed with calling attention to a 
growing area of concern. It is the belief of the author that 
views and concerns expressed in this paper are generally 
shared by data base managers and computcr^ystems personnel 
who frequently emphasize their strong interest in further de- 
veloping the relationships and functions discussed in this paper. 
It is desired that* by presenting some of the existing problem 
areas, this paper will invite further constdcratton of ways 
through which the administrative function of an educational 
institution can be made more efficient and cfTcctive. 
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The purpose gf this paper is to report on a three-month services ofan international trade center — housed over 400,000 

mission to Kuwajt, v^ichv;as supported by UNESCO and com- citizens and an equal number of non-Kuwaitis. In the preceding 

pleted in Mareh, The overall nl'tsion wa^ undertaken to ten years* the population in the secondary schook had increased 

establish a developnient office with institutional research as a by 20% per year and* in 197^, five students were enrolled for 

principal component. The proposed functions of the develop- every one enrolled ten yeais bftfbre^ 
ment office were: to be a center for information needed, plan The university actively responded to the educational needs 

the V. !erly deveiopni^inof the University ofKuwaiti improve created by a rapidly growing population and helped translate 

^edecision-makingpiocess, develop the cuirieulum, evaluate ti^ general population growth into projections of urtiversity 

progress toward stated leamin;; objectives, and introduce new eniollmeitt growth. It cooperated with other planning agencies 

technology into the university. The term /lUi/M/^^ie^/r^f^arc/i to make realistic estimates of the gtowing needs for teachers* 

was taken to mean those administrative functions which related engineers, doctors, lawyers, economists, etc., based^in part, 

observed perTormance to stated institutional purposes. upon the degjee to which the population of Kuwait was willing 

The mission was conducted in three phases^ The first andable tofill theseprofessionalroles. To^elprajseitsgeneral 

involved review of previous management studies; the second level of education, the university had to know the total plan for 

involved conducting interviews withUniversityCOuncil mem- education in Kuwait and to know how university prograEns 

bers, administraton, deans, andacademicdepartmy headsas related to it. ^r example, so that consumption would be 

well as collecting student opinions using a questionnaire de- distributed and work disciplines established^ it wasa matter of 

velopcd for this mission; and the final phase involved the national policy to provide employment for any Kuwaiti who 

dr. *ngofa plan followed by detailed discussionsof that plan wanted an education and it was necessary toassure the Ministry 

with theiectorOfKuwaitUhiversityand thesecretary.gencial. that this policy was being implemented by the university. 

Economic conditions. The'econort^ of Kuwait is a nar- 

Background rowly based one with a small population (undtr one million 

In i97^t the University of Kuwait was relatively new living in six thousand square miles* a rapid growth rate, and a 
(founded in 1%6), small (4OO0 students), undei^giaduate and high gross national product^ resulting in a very high per capita 
professional (arts & education, science* commerce, economics, income (around $8,000). Virtually the only source of income 
political science, bw. medicine, and engineering) and tradi- is oil, with almost all consumer goods being imported. In 
tioi*al (established by Egyptians on the British model), it 1974, the annual financial reserve for city govcmment opera- 
sought a workable autonomy within the Ministry of ^ucation tions was around six billion doUais. 
ano a meaningful role as an instrjment of regional develop- Rapid acctmutation of fina^^ial reserves of this m^nitude 
ment^ It ^"as well financed (operating budgets of around placed a strain upon all agencies of the government to develop 
$20,(XX),00O per year and a building prognun of $500,000*00^) at a rapid rate. Universities, which tradjtk>nallly take time to 
and well stafred(^l teaching staff men^rs at all ranks holding mature, carry an extra burdtn when placed under pressures to 
a Fh.D* or other terminal degree). It M-as the only university in graduate people &om programs before the programs are fully 
Kuwait and needed to operate within certain geographic, demo- devdof^d. Rapid growth had caused planning parameters to 
graphic, and economic conditions. . charge abruptly which created major problems when the par- 

Gkogrdphlccondhlons, Kuwait is located on the Gulf* ^t ameler and/or the changes were based on iuadequate or wrong 

the extieme eastern edge of the Arab world, at the center of information. At the same time, the university had to grow to 

gravity o^the Islamic countries/near the mouths of the Tigris meet new needs. It could not become paralyzed into delays and 

and Euphrates rivers and the obligatory point of passage to the in^tion. While the availability of money seented to be a stable 

Far East* parameter for the next twenty years, the growth rate of the 

Kuwait University was very mitch aware of the geographic state of Kuwait demanded a prompt and informed response to 

characteristics of culture the state wished to preserve, the changes in other planning parameters debated in a continuously 

historic role of Kuw?'^ in die Arab wodd, the Islamic traditk>ns* changing environment. The university had to attend to shifting 

anc* the crafts xif. uie sc2. ' *a; development of a 'ibrary, priorities and able to specify, within the limits of convcm 

museum* or arts cuinculum, for example* required specific tional analysis* the consequences of actions taken in response 

information so that present practices could be viewed in the to changing situations. It needed to look into the future and 

light of traditions* cultural values, and social developments. gather information on probable future events and their con- 

The university was actively engaged In regional development sequences^ 

activities which needed detailed information that would help UniversUyorganizatIon.TheMinisterofHdicationchaiied 

relate academic programs to the Gulf State^ ^d to the Arab the University Onincil which was comj^sed of the rector, 

world as a whole. Statistical reports and the analysis of regional secretary generalise vcn dcansof faculties, the undcr-secretary 

daoi were needed to support university cooperation with the of education, a representative from the OfVfce of His Highness 

Arah world and international programs. the Amir of Kuwait, three pnominent citizens from the private 

Demographic ccfttditlons* In 1950t there were fewer than sector^ and three citizens from the public sector. The rector 

50,000 Kuwaitis living In the walled capitiil dry of Kuwait. was responsible for academic matters of curriculum* faculty* 

By 1975* the capital — 9. modem city with all the gpods and studentst academic taci!ities» a^td evaluation of performance. 
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The sccretai> general acted as the overall supervisor of the 
administrative operations of the univefsit>, Fwc dean^ headed 
faculties of science, art^ ^nd education, la^^f commerce^ eco- 
nomics and politk:al science, and Mvomen, The sixth dean 
headed the College of Medicine and an engineenng dean had 
recently b "n appointed. The i^ectetary general ^^as aided by 
two assistant sectetaries* one for general scrvtees ^nd one for 
finance* 

The Ptobletn 

Ptcvious management studies had establishe<l tv^o types 
of prcblems. the reporting systems and the data systems. 

Reporting systems* The problem of a reporting system 
wa& identified in 1974 by Arthur Young and Company vbho 
reported the following: 

. . , There does not seem to exist any strtictuied and 
approved management reporting system. This is a seri- 
ous shortcoming which prevents efficient managentent. 
The tendency^ therefore, exists to request :pccial reports 
to nteet each problem and situation as it ahseSp Invariably , 
such reports have to be submitted on short notice and 
they tend to be, therefore* neither complete nor as 
accurate and timely as they should and could be, (p, 13) 
These consultants, aJong vb,th the university committee 
which studied the problem, urgeU the university to establish 
Some form of a developmem office* 

Data systems. Problems with the data systems can be 
itemized as follows: 

L Faculty dQta bank, A systematic report needed to be 
developed which would identify the source of faculty 
memberSf the number contracted for future employment, and 
the contract status of all faculty. It was felt that a faculty data 
bank would greatl> complement the student data bank then 
being establij^hed, when both data banks were operational, 
some of ihe planning needs of other administrative units could 
be met. The Development Office was to conduct a project to 
accomplish this, 

2. Comparative 4ata on admission and registration sys- 
tems at other universittes. These data needed to ^ analyzed 
to show implications of the elective system for admission and 
registration because there was belief th^t many problems could 
be avoid^^ if the consequences of decisions were made clear. 
The anai>ois was to ^ made by the Development Office, 

Z- A pragram budget code. Accounts had always been 
prepared by object code (salaries, expenses* buildmg» et^,) 
and, therefore, an analysis of the cost of programs (teaching, 
research, public service) by units (colleges and departm(*^ts) 
was difficult. Increased use of the computer helped some, out 
the major problem ^^as still the need for an accurate system tu 
code expenditures, A more profound problem ^^as the f^r 
a system which would allow each unit to assume responsibility 
and accountability for its own budget and Mvhich would give 
each unit the discretion to make flstal dc^iMons based upon 
program needs. The Dcve*jpment Office v^as to work with 
experts or consultants to help establish a system. 

4. Data for planning stores inventories, A management 
survey of this inventory operation was expected to identify the 
data needed, rules and ratios for orderingf computer system 
applications, etc, A pilot study had been conducted by the 
Faculty of Commerce, and this assistance waS found to be 
helpfuL The Developn^nt Office needed to identify irinova- 
tions from the general literature but would not become directly 
involved in any pro^ct as specific as this one. 

The Plan 

The plan for institution; ' research included the functions, 
methodSf managementi studies staff, and criteria for evaluation. 



1, Functionsandthercl^sddata. Teachic^ jIu dents (en 
rollment projections, demo^^raphiL dat^f attauJe^, etcJ» Em 
pluying faculty (background ^md tmii,mg, ^or}. load analysis, 
working conditions^ etc,), L'c&igning curriLul'ini (course load 
matrix^ sec ion size analysis, student credit ^ oviv^ cost, etc, J, 
Utilizing space and faciltttes .m utih^ation, ^^^ecaal instni4. 
tion criteria^ formula for com analyb,s, e!c*>* L.vpanding re- 
sources (budget ppeparationf progran; c'-i ullccation* manpower 
needs» etc.)* 

2, Methods and examples of data sources: Analysis of 
existing data (registration* payroll, etc,)* Analysis by con 
sultants (cost analysis of instructional TV)* Questionnaires 
(student and faculty opinion sui «eys). Interviews (analysis of 
department operations). Systems analysis (management an 
formation systern); Experimental research (evaluation of testing 
procedures), 

3, Management tools. Job descripiions (director, institu- 
tional research, instruciional development). Task analysis (pro 
jects* manpower required* trade-off analysis. 

4, Institutional research studies. Studies of institutional 
data were to come from two sources, teaching and learning 
having to do with faculty, students, and cuniculum; and ad- 
ministration having to do with administrative staff* capital, 
and fiscal affairs. Several methods were to be used to analyze 
these data* They were (in order from least to most man hours), 
existing data (in computer form), consultant's reports, ques* 
tionnaire answers, interview reports, and experiment scores. 

When studies were classified by this method, it was 
possible to approximate the amount of effort r^uired for any 
group of studies selected. When man-weeks of Mvork were tie J 
to the task of analysis, it became clear that even a full staff 
could not pc^j^ibly do alt the studies. An institutional research 
professional was then to nieei wtth the development office 
director and establish a priority for each project. With experi 
ence, the man week worl; estimates Mverc expected to change. 
New .schniques (especially computer) could make m^r 
changes in the effort estimates. As new studies would be 
requested, old studies would have to be completed or discarded. 
New staff vvas to ^ justified only in terms of a careful study 
and adjustment of the task analysis, 

5, Staff qualifications and duties. The major institutional 
^research-related staff positions were to be those ^f dirc*;tor and 

Institutional research professional. The job descriptions that 
follow show the duties and qualifications of each. For all 
personnel appointn^nts, it Mvas assumed that normal procedures 
Mvould be followed and that the national policy of giving 
preference to qualified KuMvaitis mvouU be ubserved. These 
professionals were to be allowed to hold the faculty rank for 
Mvhich they were qualified m a regular academic department 
part time so that they could tea^h and perform produ^ti 
scholarly activities. 

The director. The most impoitant qualification Mvas a 
record of administrative performance in vthicL lesults had been 
produced tactfully and under difficult conditions. The ability 
to establish credibility by the production of useful reports of 
high quality mv4S also important. The more objective qualifl^a- 
tionSf in this case, Mvere more flexible and had to be w^eighed 
against proven administrative ability. The follow^ing would 
have been desirable attributes* hut. it wa^ jiolik^ly any one 
person could meet all of these conditions. 

1, Teaching and research experience at the university 

level 

2. Academic training in a quantitative area (mathematics, 
accounting, physics* etc) 

3, Administrative experience at Kuwait University 

4. Administrative experience in a ministry of the state of 
Kuwait 
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5. Command of the English language 

6. An advanced degree in education 

The director would perfonn the following administrative 
functiofis: 

1 . Assist the secretary of the University Council in col- 
lecting and analysing data needed by the council and its 
committees 

2. Sijpport faculty m^nibers in the identification and 
evaluation of innovations in outside world 

3. Supervisc^raining of professional, specialist* and cler- . 
jcal staff in the Development Office 

4. Supervise an omt^udsman who would identify prob- 
lems related to student welfaie 

5. Coordinate projects to develop university-wide areas 
and departmcnt*centered activities. 

Th€ institutianal research professional: The academic 
qualifications of the institutional research professional were 
more specific. It was considered to be important that this 
professional be highly qualified, not Only to gain credibility in 
a university commtinity but also to keep the staff small in 
number and able to do niany complex tasks. The institutional 
research professional was to hold a Ph.D. in institutionaJ 
research. 

The institutionaJ research professional would F^rfonn the 
following /unctions: 

1 . Design and conduct studies on problems ictentified by 
the director 

2. Initiate studies of university operations 

3. Assist in the collection of data 

4. Assist with studies related to the outside wottd 
Present analyses of proposed decisions. 

Evaluation 

Theie were several recommendations made about the 
evaluation which was to ^ used to nwnitor the growth of the 



Developnient Office and the institutional research function. 

If tlie Development Office was to be useful to Kuwait 
University, it should grow and expand with the university* but 
it should never be allowed to become too lar^ge (more than one 
and one^half percent operating budget) because it then would 
begin to be in/olvcil in internal problcnfis (personnel, budgetSf 
origan izational structure) of the Development Office and would 
not have the time to devote to the problems of the university. 
There w!£re certain factors which would cause the offtee to 
grow and these are noted below. 

Useful reports: The more useful reports are to the userf 
the more he orshe will demand. It is, therefore, very important 
to keep reports user^oriented by regular interaction with users. 

Change: The more changes that are introduced into the 
university, the fireater will be the information needs. The new 
course unit system illustrated this point. 

Kuwaiti administrators: As the university moves from 
contract administrators with defined responsibilities to native 
KuwaiUs with general interests in the whole of the university, 
more information will be required of an interdepartmentai 
nature. 

Manpower planning: Several people view the main fune* 
tion of the Development Office as manpower planning. As this 
view prevails, more information and more staff will be needed. 

Budget review: Several people view this as a function of 
the Development Office. The more the office engages in this 
kind of ^tivity, the more information and staff will be required. 

Computer development: This is perhaps ^e single mc^t 
important unknown in the growth equation. Sophistication in 
computer management information systems, administrativ>^ 
procedures, and academic utilization will dramatically change 
the character and staff rcqujrementsof the Development Office. 
While the specifics are not clear, it is safe to assume that, as 
the computer applications growv the need for additional data 
will alsogJOw. 
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Aint': dnd Background 

Staled briefly, the aim of the Oiganization for Economic 
Cooperation and Development (OECD) Programme on lustitu- 
lonal Management in Higher Educf^^ion (IMHB) is twofold: 

1. to faciliiater within panictpating universities or equiv- 
alent institutions, the development of a capacity (or betfl^r 
mans^ement oflheir affairs through interinstitutiona] coopera- 
tion 

2. to provide for a wider dissemination of practical 
methods and approaches to institutional managemen;. 

The IMHEprogranime has been in existence for over nine 
years. Its first phase^ involving eight associated universileSr 
was sponsored by OECD's Cenoc for Educational Research 
^nd Innovation as a pilot exercise in conducting fie1d*Ua^d 
studies on institutional tiianagenientproblems. Begun in mfd* 
]968r it was completed at the end of 1971. During the second 
phase (1972-76)^ the programme functioiied as one of the 
centre's decentralized projects. This is continuing for the third 
phasCr which staned in January \iT? and will continue through 
1979. As such, while continuing to develop as an activity 
managed by the or]ganizationr the operational budget for main* 
taining its central staff is now entirely seir*financed through 
annual, vohintaiy contributions paid by the institutions p^ici* 
pating in the programme. Today, the programme serves ap- 
proximately 100 member institutions in 19 OECD memt>er 
countries. 

The First Riase 

The bunching of the programme in 1968 coincided with a 
period of considerable student ume^ in the European univeisiti^. 
This, coupled with the need to adapt to the requirements of 
cer^trally legislated reforms designed to reduce these tensions, 
caused universities to focus mote attention upon the manage^ 
ment problems facing them. It was cle;v, however^ that the 
universities were ill*prepared for undeitahing systematic exam- 
inations of their internal problems^ In large pait, this was due 
to the fact that the skills needed were generally unai^ailable due 
to the tendency of academics to| remain within tUe strictly 
defmed confines of their individfial disciplines (economics, 
staiistics, computer science* etc.)i ^ 

In Older to stimulate interdisciplinaiy research, teams of 
academics and administrators weie set up in eight European 
universities to study different aspects of university management. 
Six majo^dimensions of university management were identified, 
namely: decision*panicipation, finance, informationt/student 
and staff flows, physical plant and equipments and academic 
planning. The results of these studies were presented at an 
evaluation confeietKc held in Paris in November 1971. The 
conference marked the end of the first phase and had as one of 
its purposes an evaluation of the work carried out during the 
first two years, with a vie;iv to making recommendations for 
future work. The progimme, as it exists today, is the opera* 
tional realization of many of the recommendations made at 
that time. / 

The evaluatiOH/tonference recognized the need for, and 



the widespread interest in, the further development of specific 
approaches to university management. As a consequence, it 
was feh that a mote systematic effort or;ganize and dis* 
semtnate .available information on university management 
methods wa^roquired, assisted by appropriate efforts by in- 
(emational organizations. Specificallyi the conference recom^ 
mended that the research and development efforts^ which 
constituted the first phase, be used as a starting poim for a 
more widespread and intensive effort of cooperation among 
those institutions wishing to initiate such research. 

During 1972, all European instimtions of higher education 
in the OECD area^ as well as a selection of North American 
institutions^ were invited, either directly or through theappro^^.^ 
priate national auOiorities, to participate in the next phase. 
Tlio^ interested were asked to provide an indication of the 
t^pes of activities which they wished to pursue and, where 
cooperative research was involved, to assign priorities to sug* 
jested topics. Based upon th^ responses, the centml staff 
began to set up different services to be offered to members and 
to assist them in designing coopemtive research projects. On dK 
basts of the project proposals, governmental bodies and Private 
foundation^ were approached with a view toward obtaining the 
financial support necessary to carry out the proposed work. In 
this wa^, support for several projects was obtained from na* 
tional authorities and from companies of the Royal DutchShell 
Group in the countries concerned. 

As the 1971 evaluation conference had recommended, a 
meeting of persons from those tnsthutioas which had expressed 
a definite interest in participating was called in January 1973 
to consider a definite prograrp of work reflecting their several 
interestsand to make proposals for its origanization and financial 
support. This meeting was the first general conference of 
member institutions of the !MHE programme. _ 

The Evolution of Research during trie Second Phase 

if the approach to research in the second phase is to be 
distinguished from that of the first phase* the current approach 
may be characterized as more prc^lem oriented. Rather than 
seeking to investigate some dimension of university manage* 
ment, research in the current phase has been addressed tosome 
specific management problem which universities are facing. 
How can research be better managed? How can the retention 
and completion rates of students be iitiproved? How can insti- 
tutional performance be measured and monitored? What are 
the costs of the different teaching and training activities in an 
institution? Ttiese and other specific problems have been tackled 
in very concrete ways jn research projects designed to lead to 
practical results. 

The larger number of institutions participating in th^ 
second phase made it possible to identify groups of institutions 
facing commonr orsimilari management problems* Researchers 
and administrators from several institutions could then be 
brought together tojointlydesigfi a research project. A total of 
56 institutionsparticipatcd in the, 12 research groups constituted 
during the second phase. 
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This cooperative approach 10 problem solving has several 
dt&ttnct advaniagp^. Teams nia> design a eommon nielhodolog> 
for applieadon in the diHerent panicipating institutions^ thus 
pfovidinga test of its general applicability. A division of labor 
can also be agreed to by the group (e.g.^ one team sets up a 
classification^ another defines data to be coilccted^ a third 
studies the utility ofdiHeient statistical procedures^ a fourth 
designs a questionnaire, etc.) which tan result in significant 
savings over an isolated^ single-team approach. A pooling of 
intellectual resources and enlargement of the disciplirtcs which 
can be brought to bear upon the problem is also a feature of 
this group approach. 

There are, jn fact^ numerous advantages to this approach 
which have been demonstrated in practice. There is also an 
additional cost involved which arises Gtom the need fot coordi- 
nation* but experience to date would seem to demonstrate that 
this cOst is offset by the advantages, provided that the problem 
under study is of sufficient jmponance and ^neral concern to 
merit a joint approach. 

In several countries, the existence of IMHE research 
groups provided a basis for oi^ganizing informal steering groups 
comprising not only administrators and researchers in the 
individual institutions but also representatives ^f different 
national bodies with ^n interest in higher education. Since the 
viewpoints of individual institutions and national bodies ofken 
differ on higher education issues, a mixture of these viewpoint 
on a national steering group, especially one which is not 
fofmally constituted* provides an excellent opponuiiity for 
improved understanding* Although it is not possible to measure 
its exact value, this is certainly a by-product which can* in 
some instances at least, be looked upon as a positive contribu- 
tion of the IMHE prpgramme. 

Although it is rrat the intent of this paper to describe the 
woric of each of the 12 research groups, some examples of 
these projects will provide the reader with an indication of the 
types of institutional research undertaken. For example* a 
group of seven universities in FtaiKc studies methods for 
calculating unit costs of activities and outputs. Until 1968. 
budgeting for all French universities was carried out centrally. 
More recently, however, reforms have been instituted which 
provided universities with mofe autonomy in deciding upon 
the internal allocation of the global amounts provided by the 
national authorities. For historical reasons, however, univer- 
sities did not have at their disposal any ^kdcquate procedures for 
detennining the unit costs of their different activities. Under 
this project, a common methodology was developed and tested 
for cvaJuating both the total andunit costs of teaching, research, 
and admin^lrative activities within universities. In addition to 
testing its general applicability in France, universities in 
Belgium and Switzerland were included in the group for com- 
parative purposes, 

In Austria, a group of universities undertook a systematic 
statistical analysis of data on student success and failure dunng 
the students' academic careers. In this way. ^t was possible to 
detcfminethe predictability of student success or failure cn the 
basis of student performance in the earliest phases of their 
studies;^ The monitoring of such information provides a tool 
for improved student counselJipg. 

In the United Kingdom, where there \s a dual system of 
universities and polytechnics, these two types of institutions 
te;imed together to carry out research on the identification and 
measi^ement of indices of performance for the teaching func- 
tion in higher education. A framework for per^rmance assess- 
ment* in ttms of response to the learning opportunities, was 
provided* and resource utilization was develc^)edand tested on 
data from Lancaster Polytechnic and LoughbonH^ University 
for the academic year 1972-3. At a diseipline level of aggrega- 



tion, few significant differences in response were found, but 
quite different patterns of instnictionjeading to very different 
unit costs, were identified. 

In Japan, an investigation of pattems and practices of the 
decision -making process in institutionai management involved 
the collection of detailed infonnation and data ffom over iSO 
institutions On the ev(^ution of their decision- making stnictuies 
over the last 5 years. A questionnaire survey of the attitudes 
and opinions of more than i .800 faculty numbers towards the 
dec is k>n -making process was aJso carried out The study of 
decision-making structures showed that, following the campus, 
/unrest of the 1960$* many new committees were established, 
but, whereas participation was gerverally extended to junior 
faculty members in the process, little implementation of student 
participation in institutional management Was noted. This was 
the case, despite the fact that the expansion o£ student partici- 
pation had been strongly demanded eit_^r by students them- 
selves or by many faculty refonn commiittees'establishpd during 
the campus unrest. The survey of iridividual faculty members 
. sought to reveal their attitudes on such matters as professional 
roleSt'the composition and conduct of faculty meetings, uni- 
versity governance, and refonn. 

During the first phase, the central staff itself carried out 
comparative research on the distribution of staff and space 
between and within the university- type institutions. This in- 
house research funetk)n was not continued in the second phase, 
however, in of^Jcr that the central staff could develop new 
types of activities to be of&red as services to the member 
institutions: 

Services to Members 

In prepanng for the second phase, it was recognized that 
not'all institutions would wish to be epgagcd in a cooperative 
research project. Many institutions surveyed had indicated that 
they were interested in joinir^ the programme to take advantage 
^ of the opportunities it offered for an ongoing exchange of 
infonnation in the field of institutional management. 

A quarterly bufletin* Phase 2^ was chosen as the means 
for keeping members informed about the different activities. 
The first issue, eight pages in length, was published in June 
1972 and contained only information about the programme. 
During the following years, the bulletin was expanded con- 
siderably, both in length and coverage. By 197^* it had grown 
in 'ength to 20 pages, and its coverage included invited contri- 
butions from individuals on stibj^ts of professional interest, 
while it continued to report on the different activities of the 
program. Beginning in 1977. this bulletin will be replaced by a 
more substantial one. intemationaJ Joumal of Institutional 
Management in Higher Education. Addressed to managers and 
administrators of institutions of higher education, as well as 
researchers in institutional man^ment. this journal will keq> 
them informed of current intcinational developments, trends, 
and related research, 

There were a number of additional services organized 
under the program for assuring'^an ongoing exchange of in- 
fonnation and personnel. In its Survey of Managerial Practices 
and Innovatbns, the central staff collected, organized, and 
disseminated to all its members, a large body of in£airTnatk>n 
On the state-of-the-art of institutional management. 

The AIR-IMHE exchange program made possible the 
transatlantic exchange of 20 North American and 20 European 
specialists to attend meetings of the two organizations. Since 
most of the IMHE institutions are located in Europe, this 
exchange provided an opportunity for a cross^pollination of 
ideas between Europe and North America which was not 
otherwise possible^ given the limited Nortli American member- 
ship in the programme. Although it has been decided to 
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discontinue this cxchai^c in its present form. AIR anJ the JMHE 
programme plan to continue a eoopcrative exehai^e activit>. 
In its new form, the pfogramme will offer AJR members 
a<;ststancc in scheduling professionaJ visits to Europe, and AIR 
will reciprocate when the JMHB members visit Nonh America. 

Die Special Topic Workshops are another form of ex- 
change which brir^s together aditiinistrators and reseaKhers 
who wish to exchange views and rcseaith findings on partieiilar 
problems in their institutions, e g problems of managir^ a 
geographically dispersed institution; problems of managing 
medical schools, etc. The biannuaJ general eonferences are 
additional occasions for the representatives of member 
inttitutions \q acquire information and exehange views. 

Professional Training Seminars 

Early during the scond phase, it was felt that the JMHB 
programme could provide a valuable service to its members by 
ofganizing professional training seminars at the international 
level on topics of current interest. As a result, a seminar on 
program budgeting was organized qH an experimental basis in 
October 1973 In view of the favorable response of participants, 
a proposal was submitted to the Ford Foundation for a grant of 
$100*000 which made it possible to hold four additional 
seminars during the period from i974 to 1976, A total of 524 
participants from 18 eountries attended the five seminars. 

The seminar series eovered a variety of topics. Included 
were planning models, information system?, student counsel- 
ling, and research management, A set of baste documentation 
was prepared especially for caeh seminar and. in some cases, 
this ^ocumetoiion was supplemented with other materials and 
published in book form The programme will continue to 
organize professional trairung seminars, the 1977 seminar being 
devotecji to facilities management, 

ThelMHE training activities included other experimental 
approaches A training course organized joindy with the An- 
glian Regional Management Centre in'Danbuiy, England, 
was a Small group, residential course which was highly intensive 
in terms of lectures as well as discussions (formal and infonnal) 
between participants and leaehmg staff. Another feature of this 
course was its division into three. one*weck blocks of instruc- 



tion, spread out uvcr a period of months, which gave 
participants time to rcflevt upon what ^as taught m each block 
and to apply and test some of the concepts in thejr own 
environments. 

Another experiment ^as the louring seminar which con- 
sisted of a team of expens in institutional management traveling 
to different countries. The ^mxnar^ were attended by over 110 
higher education admini^ktraton^. planners, and researchers from 
S countries and proved to be an effective means of reaching 
more intercMed persons than would have b<*?r, possible if they 
had been held in another country, T^ns. in fact, was the 
original purpose for proposirig the touring seminar. The homo- 
geneity of the backgrounds and interests of participants also 
led to a faster and better focusing on issues for discussion. 

Membership 

Any public or private establishment or institution re- 
sponsible for higher or postsccondary education artd belor^ing 
to a member country of the OECD may become a program 
member Additionally, public or pnvate nonprofit-making 
organizations, ^hose main concern is higher education and its 
managements^ may be selectively invited to join. 

Although membership ts open to insututions in any of the 
OECD countries, participation to date has been pnmanly in 
Europe. wJhere institutions can derive the full benefit of the 
various meetings organized ai OBCD Headquartets m P^ns, 
The result has been that the large amount of onginal and, 
mformative material ^hich has been produced under the aus- 
pices of the programme has not received wide circulation in 
the distant OECD countries \Australia. Canada. Japan. New 
Zealand. United States)- Seeking to remedy this situation, the 
directing group responsible for the overall supervision of the 
IMHE programme has studied ways of making available to 
universities, and other institutions of higher education^ all 
materfaJs provided to full members for a substantially reduced 
fee. Additional information pertaining to full membership and 
subscriptions may be obtained by wnttrig to the following 
address. Programme on Institutional Management tn Higher 
Education, 2 rue Andr^-Pascal. 75775 Pans Cedex J6, France, 
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GETTING INFORMATION INTO COMMUNITY 
COLLEGE DECISIONS: STRATEGIES, IMPACT, 
AND IMPLICAIIONS 

/ 



/ 

/ 

At the outset* it is essential that several points be made as 
context for this position paper. First, accountability in higher 
education is cunrntiv a fact of life and ^^ill assume ever- 
encompassing dimenstlons I particularly tike the following 
nontechnical dcfinituin of accountability , although the author is 
unknown' ""Cveiy person (or group) in an organization is 
answerable (responsible)* to some degree, to another person (or 
position) for something (or objectives) exprcf ^d in terms of 
performance levels (results or achievemencs) to be realized 
within certain constraints." Given this Zeitgeist it becomes 
very important that decision making beconte more reliant upon 
aceurate, relevant, and timely information. 

Second* community eollege planning, policy fbrmatk>n, 
gove mance procedures, and dec is ion -making processes will be 
increasingly influenced in a more direct fashion by external 
individuals and agencies. Among other outcomes, administra- 
tive duties, including both line and staff responsibilities, will 
become trtore managerial in nature. Also, there will be (a) more 
reliance ^ipon medium range forecasting capabilities and (b) a 
need to balance resources against identified community needs/ 
demands Rnally* it will beeome increasingly important to 
explicate institutional goals and objectives for external groups 
as a framework for future decisions and performance evaluation. 

Third, the notion that two-year college research and 
planning resides in a single office or individual h a miscon- 
ception Although the offlce should serve as information clear- 
inghouse, this paper holds that planning and decision making 
arc ongoing processes carried out at many levels by all staff 
members Further, as the individual most knowledgeable about 
data definitk>ns, explicit and implicit assumptions, and institu- 
tional context, the institutional research person has, a service 
obligation that extends beyond data manipulation to the transla- 
tton of numbers into alternatives. 

Fourth, although it is essential to keep source data docu- 
mentable and apolitkal, the informatk>n ofTiccr should also 
provide low profile assistance to the college staff in developing 
systematic decision strategies and a mindset for conflict manage- 
ment Of necessity, he or she will beeome increasingly drawn 
into the political arena The position advocated here is that two- 
year college researchers can no longer say, "I just generate the 
numbers but I don*t make any decisions They must keep 
information free of bias yet contribiite their professional judg 
ment, appropriately couched, when solicited This concept will 
be developed more completely, with applicable constraints, 
throughout the paper. 

Fifth, even though the Natk)nal Center for Higher Educa- 
tion Management Systems (NCHCM5) modek arc principally 
oriented to four year colleges and universities, the information 
system has been designed, modified, and structured to be 
compatible with the unique nature of the two- year college. As 
such, a places heavy emphasis on instruction and continuing 
education in non traditional modes. 

Sixth, the system makes no pretext of beinga panacea. It is 
a sophisticated scries of tools to (a) addrc^ss simultaneously the 
myriad factors influencing an f^vent, <b) encourage an individual 
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to make his or her assumptions and decision process explicit, (c> 
establish an historical data base upon which the college can 
rely , and (d) shift in^uiutional change processes from happen- 
stance to predictability. Unless a^ollege employs these rneihoJ- 
ologies, it could destroy the very thing it is tryingto save. These 
processes, however, must be ongoing and repetitive rather than 
unidirectional. Rnally, this paper diverges somewhat in style 
from the traditional technical-conceptual format and includes 
human reactions encountered when an entire college co:. fronts 
the reality of accountability to the public it serves. This is a 
dimension of empirical assessment that institutional researchers 
have treated lightly in their quest for quantification. They must 
be more sensitive to charges that "they know the cosi of 
everything and the value of nothing." 

The next section will highlight briefly a comprehensive 
two-year college information system (MIS) framework and 
modeling/simulationcapabiliry.It Will include development of 
a common langui^c and organization of an instinittonal reseaith 
structure for maximum impact to the unique natures of the two- 
year instinitions. 

A third section addresses itself to vanous impact poinis 
during construction and resultant empincal information avail- 
ability. These impacts include perceived changes in level and 
quality of decisions throughout the college: on the board, 
administration, faculty, staff, and students. The final section 
attempts to project a probable evolution of these impacts on 
several areas, goal/objecttve formation, negotiations/college 
governance, staff awareness, accreditation, college-community 
relations, state agency/legislatu re-col lege relations, intra-college 
interdependence, grant development, program evaluation, and 
plan ning/fbrecasttng. 



Information System Structure 

Figure 1 depicts a two-year college information/resource 
analysis system. Establishing such a system and integrating its 
output into decisions^is accomplished in four general phases. 
The first phase centers around ascertaining a collegers current 
data structure. Specific tasks include identification and defini- 
tion of rejevantdataeicmcnts, charting information How through- 
out the institution,^ and delineation of college mission, goals, 
and objectives. Also, one must identify the college organization- 
govemance structure <formal and informal) inctudingauthonty, 
responsibility and domains, current decision rules and recumng 
cycles or practices, and others. A second phase primarily 
involves consttiictton of a data base. The circle in Rgure I 
represents a computer-based, interfaced set of Z master files 
containing basic components of an institution's operational ex- 
istence. Each file, students, curriculum, facilities, programs, 
finance, professional personnel, classified personnel, and 
equipment, contains both static dat^^^cmcnts which are secure, 
except for established modification procedures, and variable 
elements which are altered as Verifiable changes are necessary* 
There are extensive edit-error rounnesboth within and between 
files to maintain their completeness and accuracy. Each separate 
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Figure 1 . Yakima Valley College resource analysis system. 



nie produces a summaiy operational report whih: inlerlinlced 
nie outputs produce valuable management information. 

Phase ^ree (represented on the lefit side of Figure I) 
involves opcrationalizing a descriptive informaiion system. 
V\Q resource analysis component programs are centered around 
NCHEMS and locally designed computer models. This in^ 
formation system is designed for administrative management, 
although Ihe stnicture allows data Imse access for related 
research. Data from student and curriculum files provide input 
to produce and ICLM/IWLM by department and program. 
Faculty Data Generator identifies each staff member as a cost 
center as well as tabulating departmental work load. Rnally, 
RRFM L6 produces a breakdown of directandsupporteostsby 
department and unit cost per program. 

Besides the NCHEMS sotlware, a local program profiles 
each department and instniclor as in Figure IThc department 
profile is divided oito 7 sections, descriptive eharactcristics^ 
student work load* full time/part tiniK total faculty work load^ 
addt^ onal resources* productivity indices* and unit cost indices. 
Thest values are compared to divisional and college wide 
norms. Additionally, this program rank orders and graphs 
departments by any variable displayed An instnictor profile is 
essentially the same except for norms which include college 
average and full-ttine or part -time composite, depending upon 
instnictor employment status. Rnally, the program will also 
accept uscr^flncd work load ranges* including expected value 
for both department and Instnietc: . jtlemsi as additional refer 
cnce points. / 



Phase four contains the most sophisticated and dtflflcult task 
series. F^ure 1 shows a predietiye/simulation capability utilizing 
descriptive software plusalocally created program that calculates 
appropriate regression equations from user-supplied input and 
graphically plots trend lines over a specified horizon. Major 
college reactions to outcomes of each phase will be subsequ^ady 
highlighted. 

Information System Impact ' r 

The MIS described above has taken approximately 2^ 
man-years to design and make operational. Impact on all 
segments of ^ college has been dLverse, dramatic, and not 
entirely predictable. Possibly the best way to illustrate is by 
deii:nblng regnant system impact points and relating staff 
reactions as constraints and assumptions become germane. 

A first significant impact occurs when the entire concept of 
a comprchensivc^docuntentable informaUon system is presented 
to top administrators and board for philosophicali financial* and 
staff endorsement. The information system operates on an 
implicit assumption thatacollcgecanbemanagedand that there 
is a greater probability of correct and prudent decisions when 
they are based upon complete information. An additional premise 
states that all information, and its derivation having a bearing* 
is open to all who are directly involved in the decision. A top- 
level commitment to institute and maintain this MIS usually 
produces ambivalent feelings within the board* president, and 
deans^ In an era of faculty-administration confrontation, there 
arc natural fears of exposing weakness and not understanding 
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Term: 

( I) Total class sections .. . 

( 2) Total credit hours . . . 

{ 3) Total student enrollment (HDCT). . . 

(4) Total S(udentFTE (PTES). . . 

(5) Toial sludent credit hours (SCH). . . 

(6) Total class contaci hours (CCTH) .. . 

(7) Total sludcni contact hours (SCTH) .. 

( 8) Avenge section size . . . 

( 9) Average class size (ACS) . . . 
Average student SCH load. . . 

(11) Average student PTES load . . . 

(12) Average sludcmCCTH load . . . 

(13) Average student SCTH load. . . 

(t^) Total full-tinve faculty headcount . . . 

(15) Total F-T faculty FTE (FTEF). . - 

(16) Toial F-T faculty direct instnict salaty . . 

(17) Total F-T faculty fringe benefits (FRIN). . . 
<18) Average direct salaiy per FTEF (FSAL) . . . 

(19) Total part-time faculty headcount. . . 

(20) Total P-T faculty FTE (FTEP) . . . 

(2t) TotalP-Tfaculty direct instruct salary .. . 

(22) Total P^T faculty frfr^c benefits mm . . . 

(23) Averagediicctsala7perFTEF<FSAL). . . 

Figure 2. Department analysis profile. 



(24) Total instruciton staff headcount . . . 

(25) Total instruction staff FTE (FTEF) .. . 

(26) Total instruction staff direct instruct salary . . . 

(27) Total instruction fringe benefits . - . 

(28) Average direct salary per FTEF (FSAL). . . 

(29) Direct Support e;(penses (DSE) ... 

(30) Indirect/chargeback expenses (ICE) . . . 
.^^(31) Total dcpannventexpenses . . . 

(32) Average credit hours per FTEF raiio (F^OD) . . . 

(33) AverageHDCTperFTEFratiQ(F^OD). . . 

(34) AverageSCHperFTEFratio(PROD). . . 

(35) Average FTES per FTEF ratio (PROD) . . . 

(36) AverageCCTHperFTEFratiofP'"^^'. . 

(37) Average StTH per FTEF is>:iO (PROD) . . . 

(38) Relative faculty toad (RFL) . . . 

(39) Relative faculty effort (RFE) . - - 

^ (40) Unit cost per student . . . 

(41) Unit cost per credit hour. . . 

(42) Unit cost perSCH . - - 

(43) Unit cost per FTES. . / 

(44) Unit cost per C<rrH. . . 

(45) UnitcostpcrSCTH. . . 



the system oTComprehending implications ofknc^irig\v hat the 
college is like Removed* ^1$o. is Ihe security of arguing one's 
position from aunique frame of reference as partiesarcduccted 
to prepare their respective cases from the sait.e quantitative 
base However.thereisalsoa positive feeling v/htchanticipatcs 
cscaptng conttntia],defonstvereactton-t(M:ii5{s,rather,onecan 
anticipatet identify « and resolve conflict from a secure informa- 
tion foundation. ^ 

A second impact occu'rsv/hen one attempts lo ascertain the 
cunent date strticture of the college. To initiate the MIS, each 
college must' Tderitify its cunent organizalion/govemance/ 
management structure, its information needs and flow, goals 
and objectives, functional relationships and decision rtiles as 
reference points. In order for a system to be Isomorphic v/ith 
college structure, the sequence of activities in this construction 
phase is essential. Also* subsequent informadon system users 
must come to ordered and precise definitions of necessary data 
input/oulput Vanabtes. They must actively participate .in the 
system design and implementation if it is to be effective. 
Typically, staff reactions are indifterence or annoyance as they 
ate asked to detail information needs and fjow tboughout their 
domains, diflTerentiate between their areas of responsibility and 
authority^ define their essential data elements, become familiar 
v/ith the concepts and lexicon of accountability, define how 
they make decisions or formulate policy, and relate cftects of 
their actions upon other areas. When an attempt is made to 
develop common decision rtiles and data element dcfinNions 
necessary to drive the model routines, one will hear such 
remarks as "Everybody should be accountable but me," and 
**You cannot quantify what I do, so I cannot be held account- 
able Administrative exhortations about subsequent informa- 
tion utilization have little eftect at this point. The stafT does not 
accept a need to be held accountable* docs not believe any 
system can handle complex inlcrrelationships among units* and 
is generally suspicious of ncfanous motives^There may also be 
negative reactions if staflf erroneously perceives these tasks as a 
time and motion study which may disrtipt established routines 
or eventually replace their jobs. 

Formation of a planning advisoiygrouptoassist in system 
desjgn and serve as a sounding board for tactics and strategies 



facilitates information system implementation. This group is 
composed of the formal and informal college leadership. Its 
members operate in an atmosphere of mutual trust, complete 
candor* and willingness to divorce themselves from parochial 
interests in order toadclressinstilution-wide perspectives. They 
have access lo all information which does not violate individual 
rights. Written posUion papers are prepared for consideration 
by the president, deans, arid staff. The information officer 
initially directs ihemasthey become familiar with concepts but 
later t)ecomes a technical consultant as they assume more 
responsibility and sophistication. This '"Rand Corporation*' 
approach provides a link between cow. '?ptua]]zation and practical 
implementation. These individuals also serve as a buffer to 
assuage concerns that new ideas being proposed arc not shallow, 
snap decisions. 

A third impact occurs when descriptive summaries from 
the data base and resource allocation/expenditure models be- 
come available (sec Figure 2\ Each college group*<i.e., hoards 
administration, division/departments, [Ko^'ams, instructors, 
classified staflT, and students) peruses the, information, and iheir 
response cover a speccnim. Although all react with incredulity 
to the mind-boggling volume, comprehensiveness, and com- 
plexity of information suddenly available for analysis* there are 
disccmable group diflTerences. Board mei nbcrs are giatified that 
their capital investment has finally bome such bountiful frtiit. 
There is also an initial tendency for them to desire morediiect 
involvement in administrative decisions rather then to retain 
theirproperrolc of policy formation. Assistaneecan be provided 
to help them understand how subsequent trend profiles will be of 
more value and teach them to ask the right questions in the right 
way. Top e^^helon administrators react favorably to tne profiles 
and quickly incorporate output intolheir daily operations^ Af^r 
available documentation hasconfirmcd some of their beliefs* it 
is easier for them to accept information at variance with 
preconceived notions. 

Reseaichers must urge caution against a natural desire to 
instimte sweeping changes based upon preliminary returns* 
System utilization must await the need lo establish a sufficient 
data bas^, determine functional relationships over an appropriate 
time frame, and make certain that the model parameters have 
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been properl> JcHned. If a iji!ycrcpanc> exists between cuKege 
fe^lit> jnd^mo3£|, it is the latter whkh must be altered. 

At this time, faculty and instnictional support areas are 
introduced to the output. Staff reaction varies, but there is 
generally a heightened jnxtet> level and increase in overt 
expressions of hostility toward the infonnation ofliuer. Staff 
uannot i<kntif> With an impersonal uomputer routine or pnnt 
out* and the> i^annot ph>sicall> attack lop administration > i>o 
the> piobabl> will vent frustration upon the system ile^igner. 
This is a critical time for incorporating an MIS into college 
thinking. Man> challenges to s> stem, design and operation 
pn>v ide an opportonjt> to explain uonstrainls and shift v itnohi. 
feelings into ereative energy. 

The nrst ehailenget typically, is data falsiHcation for 
certain groups. It is important to demonstrate that systemoutput 
is neutral ant! operates onI> according to deH nit ions and decision 
rules which vtere eollege ereated Besides being abte to docu 
ment in house source data reliability and validity, the staff 
should be encouraged io ^ek outstik veriTication that de^bions 
made about the college by external agencies employ the same 
infonnation. Also, model routines arc logical, so the system 
assumes user suppLed input data and procedures for obtaining 
it are also logical, rational, accurate, and representative of 
institutional reality. This applies to output also. 

Another ehallenge genemlly t^uestions what is really being 
measured. The MIS isa process system, so staff and administra- 
tion must be ^utioned about seizing a unitary, simpJistii. 
efftuienuy index and then compounding the eiror by choostng a 
process rather than an output measure. However, the faculty 
allegation, that department/'instiuctor profiles, prodiKtivity ratios, 
and unit cost values are not valid comparative indicators of 
contribution for resource expended, cannot he sustained. At 
the outsett such a system is designed around those elements 
lending themselves to quantification vtith full acknowledge- 
ment thatn. currently , there arc no real definitions of outcomes to 
link with resource expenditures. Also, initial system structure 
emphasizes i.uniculum,'piogtam,'instructor accountability al 
though the design un accommodate support area inclusion, 
rirst use should examine relative relationships between depait- 
menls or a single department across time rather than absolute 
values, and output most be vievted relative to a particula 
decision. The system is diagnostic rathet than prescnptivet so 
administration and staff should be encouraged to develop 
profiles jointly over time before making far-reaching deeisions, 

A third aceusation ehallenges ttte quest for unifonnity and 
standardization whii.h could destroy the very thingone istr>ing 
to AjTtderstand, A corollary *'i%4 — Big Brother*' syndrome 
argue^ that computers w ill make ultimate decisions. One must 
be prepared to point out modeVsystem ^constraints along with 
the analogy that one does not throve a^vay a. valid scale that is 
known to reliably ^eigh two pounds light, one merely addstv^o 
puunC. Some pnmary limits to highlight include the models' 
lineal programming which makes themhypersensitive toenroL 
mcnt fluctuations, their difficulty in handling infl^ton and 
marginal coUs* the emphasis on expenditures with minimal 
attempts to tie them to revenues, and an illusion of decimal 
aci^uracy on output. Also, these models are designed for utiliza 
tionaslong tem indicators, not as budget models, although the 
fitaff tendency is to utilize them in the latter mode andattempt to 
diM^ount the entire report when it does not show a budget penny 
match. Modelsdo not indicate (he efficacy of given ahematives, 
nor do they replace seasoned administrative judgment. Some 
jnfofmatton may be gleaned more efficiently in a rtunual 
fashion than by utilizing the models. 

Finally, ttie sophistication and technical accuracy of system 
reports exceeds staff wdlingness to acknowledge that com 
ponents of the educational process can bc quantified. Likewise, 



their cdpabihty to i^ompreh^nd the totatay of factors inherent 
in any nomber generated through the computer routines Jeveltjps 
slowly. 

In response to Big Brother allegations, ad miaistrators 
must tAe a leadership role in demoiistrattng that their decisions 
include the information provided, including probable altema 
tives, but that they , not thei^omputer* are still final arbiiors, and 
responsibility rests with them. Once the staff accepts this fact 
and realizes that their solicited input, t\ hen empirically grounded, 
also hasvteight in the decision process, they begin to paittcipaie. 
With planning group assistance, all college segments recejve 
in house seminars on concepts and methods of simulation/ 
forecasting utilizing the descriptive models in a predietive 
mode. They are encouraged to free their thoughts from traditional 
""it ean't be done" and test new ideas, 

A fourth impact occurs ^vhen initial forecasting attempts 
arc made. First, the implicit expectation is that models somehow 
predict the future. Models do nothing more than employ user 
defined decision rules to indicate the mature of the processes by 
which the future evolves out of the past and present. Second, 
models require that assumptions be explicated and queries 
properly framed priot to simulation. It isquitedifftcuttfor many 
staff members to eonfront the fact that their irriplieit assumptions 
and preseience are not always logical and nuional, especially 
vtith colleagues. Ttie information officer can assist inditjduaJsto 
organize their decision making strategies and, thus, improve 
communication. Third, some users vtillcarry out simulationsad 
infinitum in an attmept to avoid making a^deciston* while others 
will Ignore the MfS potential and continue to rely on a binaty 
decision making deviee. Even though both techniques attempt 
to avoid setting priorities and defining most efficient use the 
system,assumes that some optimum combination of resouKes 
does exist and has been defined by the users. 

It is important that MfS staff have essential college manage- 
ment reports made routine in ordet to concentrate their talents as 
technical consultants, facilitators, catalysts, aiid service bureau. 
Additionally* an MIS office needs to coordinate college-wide 
infonration seeking efforts to maintain or enhance an integrated 
program. This includes pubhcation of an annual statistical 
compendium and graphic trend profiles. In summaty, the 
infonnation system must be acknovtledged and utilized by the 
college as a Gestalt rather than merely a discrete ^.omputer data 
system, 

Impltcatiofis of the MIS 

Although the time frame since implementation Iioa been 
too brief to state documentable changes* some events liavc 
happened w hich could be directly attributable to the MIS, Also* 
logical extensions allovt speculations abuut future uses of the 
system and nc^ role dimensions for an information officer. 
Several distinct advantages have already emerged. They include, 
(a) a more complete and consistent refereni^e frame foi dei^ision 
making and policy fonnationi (b) a greate.* staff a^varcness and 
acceptance of their interdependence, (c)a more complete under 
standing of resource utilization and ^ontnbution, (d) a facd,ta- 
tion of managemenl/govemance* (e> movement ofi.o1lege- w tJe 
planning from creeping incrementalism toward a recurrent 
i^yclical process involving greater numbers and diversity, i,f) ^ 
feeling by the staff majority that decisions are more equitable, 
democratic, and egalitarian m nature/si,opc, agreater Hexibility 
in allocating scarce rcsouKes, more time before decision options 
need to be finalizedt and a shift m decision making from vn sis 
reactive to anticipatory -planning. One can sense a greatet level 
of eonfidence and finnness in the deeisions being made. Con- 
cepts and vocabulaiy of accountability and hustandmg scaice 
resources arc now interwoven in , staff conversations, and there is 
less fear of the "black box," The staff are beginning toexpres:^ 
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less concern about being folded, spindled, and mutilated* and 
thcyaic engaging in creative problem solving The> ate moving 
toward seJf study in a]l phases of Itie college operation within 
an institutional goals and objectives context. 

With college decision making moving to a higher plane* 
certain ramifications will accompany it. It is inevitj^blc that 
decisions ultimately resulting in progfam/staff re<]uctiop in- 
forcc or termination will be made* and litigation will shortly 
follow The Information officer will be called upon to explain 
MIS structure and operation to a judge and jury* and the task 
will be formidable Besides being in an adversarial situation, he 
or she will have to explain the complex intricacies of measure 
ment, evaluation, simulation, modeling* decision- making pro- 
cesses, and accountability to a lay group in an extremely short 
time period with large dollar amounts at stake. The dininction 
between neutral, objective information and subjective structure 
which led to the outcome will be difficult for lay people to keep 
in perspective. 

Another area where the MIS and information ofTicerwill 
enter the political arena is an interface between local planning 
and state system planning Currently, most colleger find a 
disparity between their local management groupings and the 
way they are viewed by "aiious state and federal agencies. Even 
with the advent of REGIS <NCBS) and PCS (NCHEMS) coding 
schemes, it is still essential foracollege to take the initiative in 
defining itself before external parameters are imposed. In an era 
of projected student decline^ fiscal constraints and retrenchment, 
when differences exist which affect resource allocation or 
expenditures, the MIS officer may be called upon to assist the 
president in negotiations with state and federal funding sources, 

A perennial college problem is the large amount of staff 
time and effort expended to consistently respond to myriad state 
and federal requests for information yesterday*'. Just when 
^nc fathQinsJbc^aQSH£r;li„the questions are changed. When a 
college cannot be sure whether reference points have changed 
or whether they merely represent the same points viewed 
differently, it is essential that the college decision makers have 
an internally consistent base for their own decisions. An MIS 
provides this, bur the research office will have to establish 
congruence with extemal data^bases containing the college 
data. 

Besides responding promptly and accurately to information 
requests, a researcher can provide valuable assistance to the 
grant development ofTice In addition to rapid information 
access for meeting federal deadlines, this system allows for 
comprehensive foUow up/audit It is also designed to drive off 
state agency input record formats This allows the college and 
information officer to (a) make a dinect impact on state long- 
range planning processes and <b) adapt the MIS to other 
community college with minimum modifications. 

The adaptation capability pnxfuees another merging role 
for the information officer to serve. Forming regional tnter- 
collegc consortia allows several colleges to pool resourcest 
including the establishment of comparable units and definitions. 
Given the state of the art in this area, colleges need to maintain 
their definitional integrity as context while determining com- 
mon definitions and standards. Just as words arc merely sounds 
until they arc given meaning by a user, so too is the compar 
ability of units between colleges meaningless until definitions 
are negotiated An MIS officer is in a position to strengthen 
relations between colleges utlli£ing information as a common 
bond> 



The MIS officer will likely be drawn out oftheivor> tower 
into tollege/stafT negotiations, BcMdes putting common in- 
formation on the table for both sides to use in constructing iheir 
respective positions^ the system itself will become an integral 
element as position implications are simulated. At this point* 
the researcher faces a moral and ethical dilemma of extra- 
polating point-counterpoint .^et remaining impartial ro both 
sides. He or she may also t>e called directly into negotiations if 
the system structure and operation itself becomes an issue, i,c,, 
establishing work load standards and p>xx:edurest policies and 
criteria for curriculum/instruction evaluation, dtsmis^ cntenat 
governance structure, and others. Finally, the negotiated agree- 
ment must t>e examined in detail before ratification to assure 
that MIS freedom and flexibility has not been impaired by either 
party. 

It is a fairly safe assumption that accreditation agencies 
will require more objective and empincal indicators ofacollege s 
efficiency and effectiveness in reaching their stated goals and 
objectives. The information office will play an increaiiing role 
in two ways, (a) the preparation of an annual statistical profile, 
trend analysis* simulation* and follow-up will provide extensive 
documentation for institutional self-study and (b) ihe system 
structure could become an integral component of accreditation 
requirements throughout the region. 

Another area of significance is college'conununity re- 
lations. As consumerism and affirmative action become potent 
forces, students and college district taxpayers will demand 
empirical evidence of equal opportunity and return for their 
educational dollar investment. When it is necessary to present 
the college case to various special interest groups* occupational 
program advisory boards, or district patrons ar levy time, a 
favorable vote is more likely if they receive valid information. 
The information officer can assist the staff in preparing such 
literature and may be called upon to address citizen groups. 
Another service the information office ma^be asked to Pf^^^ide 
is consultancy to district high schools, cuy governments, special 
interest groups* etc. As a cicannghouse for information^ and 
backed with technical expertise, the research office is in a 
unique postion to influence community support for the college 
and its mission. 

This paper has advocated that community college institu- 
tional research officers have a professional obligation to forestall 
standards erosion, while practicality demands that they go 
beyond system construction to get valid information into college 
dec is ion -making processes. This includes assisting the staff to 
determine analytic/simulation capability and design implement 
change strategies, as well as ascertain the appropriateness of 
such changes. Finally* they wilt be called upon increasingly to 
translate these concepts to those extemal forces influencing the 
college. More and more their influence will extend into all 
facets of the institutional operation, Thus, researchers must be 
extremely sensitive to the potentially awesome power ;hcy 
could wield. While they should not take themselvestoosenously, 
they must like what they arc supposed to do quite senously. If 
one is the primary designcr/dcfincr of such a comprehensive 
MISt controls data input, and interpretation of output to in- 
dividuals not schooled in its constraints, the possibility of 
creating an empire is present. Therefore, system dcvclopntent 
should proceed from directive to suggestive/supportive. When 
the MIS is operational* an information office will provide Ms. 
greatest contribution by being merely a felt presence and ^ 
service bureau within its resource constraints. 
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Change b the sustenance of higher education^ Beginning 
with the post-Sputnik era* we have witnessed unprecedented 
change and intense activity in our educational institutions and 
in the environments in which they operate. Jt is becoming 
mofc and tnon: evident to educational planners that forecasting 
futum trends by extrapolating from past occurences results in 
projections of limited utility over a short time period. Fore- 
casting accurately the changes in postsecondary education 
cannot be done independentty of the other social forces that 
impact on the human decision- making processes. Hiese fuctor^ 
are too closely interrelated to permit one to be foitcast apart 
from (he others as is done in some of the normative forecasting 
models We have found that cannot plan/design the future 
of the university without considering flow that future impacts 
and interrelates with other areas of the community and wi^ the 
larger sectors of society as a ivhote These sectors— business, 
community, government, industry* and public — act in concert 
with factors that are political* economic, cultural* and techno- 
logical by nature Hie alternatives availabfe to the planner 
precipitate from the interaction of these factois in Ihe various 
sectors of society In sonte cases* these interactions greatly 
expand the number of available options; in other cases* they 
reduce the number. Hie objective of forecasting is to plan for 
change so that it is orderly* not chaotic and so that the institu- 
tion is not caught off guard and unprepared for unexpected 
changes tf enrollments decline signiflcandy* as they arc almost 
cedain lodo at many institutions in the next dec^e* an orderly 
retrenchment must be planned and exccute<J. Care must be 
taken.* however* to insure that any planning for reirenchment 
docs not sacrifice the effectiveness of the institution's pro- 
grams which constitute its strengths and regress them to a level 
of mediocrity Careful planning will obviate arbitrary and 
capricious decisions on the pad of administrators and mini- 
mize the hardships created when the faculty and support staff 
must bt reduced accordingly. 

To plan successfully for future contingencies* accurate 
and pertinent information must be available to the planner 
along with an objective analysis of those data Misinformation 
or misinterpretation of information could lead to academK and 
financial failure. A number of institutions of higher education 
have had to face such disaster It has been suggested that the 
optimism of the decision makers at these institutions vias 
encouraged by Ihetr lack of sufficient information and sup- 
porting data. 

To pron:k)te orderly grov^th or retrenchment and to prevent 
future disasters in higher education* much more sophisticated 
approaches to planning must be implemented than have been 
used 'n the past Forecasting provides the peephole through 
which possible futures can be glimpsed. Forecasting tells the 
planner where change may be needed- u hat to strive for <tnd 
what to avoid it tells him what is lilcely to happen in the 
future. 

Forecasting is based on a set of meaningful asjiumplions. 
relevant data, and an understanding of the relationship between 
events and trends Hie forecaster's role is twofold, first* to 



develop reliable forecasts* and second* to help bnng about the 
desired change. Hic Utter vames with it the responsibility for 
deciding ^hat the desired cnange is and how it wdl impact on 
human or environmental considerations. Hits paper will focus 
on the kinds of information and Ihe data bases needed to 
support strategic planning in institutions of higher education. 
Data bases* as used here, should not be thought of solely in 
terms of data stored in digital of other machine -readable form 
on discs* tapes, or in computer mepiory, but, m a larger 
sense, as data lhat have been p<iFpf>sefulty collected, recorded* 
and organized in such ^ way that they will serve to help a 
decision maker in selecting from among altematives. 

The common denominator for alt strategic planning m 
higher education is the revenue available to the institution. 
Strategic planning* by necessity, revolves around available 
revenue and projections of mat revenue on into the future. 
Four major sources of financing higher education have been 
identified as (1) tuition, (2) state and federal subsidies, (3) 
private* federal, state, and local research funding, and (4) 
grants and endowments. Hie establishment and usefulness of 
data bases related to these sources will be explored in the 
remaining sections. 

Enmllment Data Bases for Forecasting Tuition Income 

For most colleges and univenities, tuition is the largest 
single source of income. It is obtained either directly ftom the 
student or indirectly through state fctmbursements. In eithei 
case* it is directly related to the institution's enrollment, Hius* 
enrollment is the first and riost important factor that must be 
considered in the production of a pimining model. To build a 
feasible model* good enrollment data arc necessary. There 
exist* however, a number of participating forces both within 
and outside the parameters of the academic T^croenvironmcni 
that influence enrollment. Figure I displays a number of these 
intemal and extcmal forces that can influence the enrollment 
stability of an institution. Hie factors shown on this chart arc 
exemplar and 4ie not intended to be an exhaustive list. Many 
other relevant factors could be added* or some of tho^ic shown 
might be eliminated, depending upon ihe iinfie frame for which 
the planning is intended. 

Before examining the factors that surround and inftuertce 
the enrollmeia circle* a discussion of enrollment and Ihe utility 
of an enrollment data base for planning is needed. Enrollment 
data* in essence* tell whom the institution has served in the 
past, whom it is serving at present* and whom it will serve in 
the future. Enrollment data thereby ^erve a^ the basis or 
beginning for the strategic planning process, llie enrollment 
statistic is the barometer of the institution becauM^ from it t^e 
faculty size* financial needs, !>pacc requirements, and otfier 
requirements of the university can he estimated. It dictates 
immediate needs in relation to class size* faculty utilization.* 
dormitory facifittes^ and auxiliary services In addtion. man- 
agement decisions as far distant as the next I0* 20 or 30 years 
must be based on enrollment projections. 

Some of the variables an enrollment data base should 
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Figure 1. Forces within and outside of academic control influencing cnrollmetit. 



include axe the number of siudents enrolled b> count> aii4 slate 
residencet school, department, undcr^gmduatc, and graduate 
status, full- or part-time status, sex, race, and class level Both 
current and historical data should be collected. The usual poini of 
reference i^ the fall tetm or semester^ however, separate data 
for each term should be available. One function of term and 
yearly data collections is to derive atuition and retention 
statistics. If the data are in machine-readable form, a computing 
facility will be able to aggregate and cross tabulate the data and 
print out firequency distributions for all variables. If however, 
in the str^gic planning process, innovations arc inuxxluccd 
which will shape or change the current enrollment pattem, this 
information must be incorporated into new enrollment projec 
tions For example, if an institution is alerted that its enroll 
ment is declining, and a decision is made to introduce new 
programs not previously offered, valid long range enrollment 
projections must be changed to reflect this decision. 

A second important area which requires data base building 
is the retention and attrition rate of students. Infbnnation in 
this area is vital to building a Markov probability transition 
maUix which is a useful input to a planning model, ti should 
be possible to answer such questions as the following. What 
percentage of an entering freshman class drops out each term? 
What percentage goes on to graduate? Which departments 
show an enrollment iitcrease or decrease? If students leave the 
institution, it may be possible to determine whether the reasons 
were academic^ personal, or financial* and if transferring to 
another college, whether it is because the eunent institution 
does not offer a program in th^eir area of interest. 

Another dimension of the enrollment model that needs to 
be considered in data base building is the policies of the local, 
state, and federal funding agencies. How much direct aid is 



available to students and the institution? What areas of voca- 
tional training or research arc being funded ot being phased 
out. and how long are the terms of commitment? If existing 
space cannot house long-range commtted projects, strategic 
planners will have to decide whether to r^nt, buy* or build 
adequate facilities. They will need to ^now whether the situa- 
tion is temporar> or whedier long-range expansion isjustiHable. 
Data to suppon the decisions are essential. 

Forces Impacting enrollment that are outside of aca* 
demk control* A nuntber of forces which impact on strategic 
planning are outside of academic control. They are of an eco- 
nomic, technological, demographic, and cultural nature. These 
fbrccs must be continuously monitored and both current and 
historical data collected. 

Economic data bases. L'conomic forces include the job 
Outlook and the growing concem about the value of a college 
education. Doubts about the usefulness of a college degree, 
especially in the liberal aits, in terms of getting a good job, 
sometimes outweigh the positive benefits that may accrue from 
a college degree. Such doubts have probably been a mapr 
factor in the decline in the proportion of high school graduates 
lhat go On to college. This proponion. according to the Na- 
tional Center for EducationEd Statistics, is 47 percent today, 
down from a peak of 55 percent in 1968. Monitoring this 
proportion is vital, not only nationally, but more importantly, 
in the geographic region from which the bulk of the institution's 
student body comes. Higbet tuitions and the bleak outlook at 
the markei place are blamed for this reduction. National em- 
ployment needs and prospects must be examined fbr trends 
which will help identify academic programs that may suffei 
significant drops in enrollment because of a tight job market. 
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Education is (he best example The data were there in the late 
sixties, crystal clear* showiiig there would be fewer students at 
the elemeniaiy and secondary level to teach. Alsoi with union- 
ization and higher salaries, there would be a slower rate of 
tum*over in personnel which would lead to a rapid saturation 
of the job market Yet colleges and universities continued to 
produce teachers far in excess of demand long after the hand- 
writing was on the wall Other disciplines and professions 
need constant monitoring to keep them synchronized with the 
national employment needs and job outlook. The Occupathml 
Outfook Handbook published by the Bureau of Labor Statistics 
may serve as the nucleus of data requirements for making 
decisions about future enrollment levels by discipline. 

Data basts related to technological developments. Data 
base builders must be alen to nev^ career horizons that are 
developing or v^ill inevitably arise from new technology. It is 
now reported that ovei one-half of the nation's gross national 
product is generated from in format Ion-re Jatcd goods and ser- 
vices (Porat* 1^76) What new technology will envrgc '"rom 
lU evolution and what forms of postsecondaiy education or 
training will be needed to prepare people for these occupations? 
Will higher education continue to move away from the liberal 
arts tradition to become more vocational in its orientation? If 
so, what are the consequences for educational planners? Wh^ 
aie the cost/benefits of the alternatives to a college education? 
What options are now open or will be opening up? What are 
the various payoffs'^ What value or wofih is attached to each of 
them'^ If information related to these types of question is 
available from data bases, planners will be given a glimpse of 
the climate and potential future demands on the university and 
its educational dellvciy systems It wilj help in disceming the 
most desirable future and the possible ways of achieving it. 

iust as technological developments in Industry prolfer 
new products or new processes to increase income or to cut 
costs, so do they offer the same opportunity for education. A 
new breed of professionals will be required to utilize new 
technology, and there wi}l be new opponunities for higher 
education to train them Colleges and universities will be 
watching developments in compute r-^iiided instruction^ in cable 
television* arid other forms of telecommunications ts alteraative 
methods of delivering education to the consumer. Universities 
must constantly be on the alen to new technology or methods 
that will increase their education-del i very capacity or reduce 
their costs Information has to be assessed in regard to these 
questions: How will technology impact with education and 
with society? Will it change society's values? What causes 
values to change anyway** Information is needed about (a) how 
the media* with its programmingt creates desires for the future^ 
(b) how social dissatisfcation translates into pressure to change 
things: c g * how a lack of stimulating, interesting jobs for 
college graduates translates into disinterest in a college educa- 
tion and a search, instead, for altcmatives with better payoffs^ 
fc) how the i^lationship between chaiigcs in technology and 
changes in life styk leads to changes in what is valuedt (d) 
how much a parents' glimpse of a better life for their children 
influcnccs the decision of these children to attend college; (c) 
how our social institutions accomplish the change in values'^ 
through formal education in our schools, through informal 
education within the family and among peers Sociologists 
suggest that a change lo a society's value system begins with a 
small group and, with a snowballing effect, grows in accept- 
ability until it is cmhraced by the majorliy Insights into these 
factors arc v'lal to strategic plannii^. 

Demographic data bases. Population demographics can 
be a valuable source of information for strategic planning. 
Centers have been established in various parts of the country 
primarily to study the socioeconomic and demographic vari^ 



abtes that impa;t on a community and its educational systems. 
The University of Ptttsburgh'sCenter for Urban Research is an 
example of such a center. Demographic data will tcH the 
planner the expected size of the pool of prospective freshmen 
cnrollees. Once again, national data are not as important as 
data from the geographic region from which the bulk of the 
students come. As a case in poim the Westera Pennsylvania 
region supplies over 90 percent ol the undergraduate student 
body attending the University of Pittsburgh. Even more im- 
portant than the number of youtvgsters living at each age level 
in this region is a data bank which iricludes th^ir post-high 
school intentions. Are they planning on postsecjndary ^ucz- 
tion? At what level — 2 year, 4 year, graduate, first professional? 
Have they selected a college or university? What are their 
career interests? An updated file, with data collected in the 
junior year of ' '^^ school, would provide a basis for profilir^ 
the potential pool of future applicants and gearing university 
^ planning to their career interests. 

There are other demographic concems. Begmmr^ about 
I9S0, students, in the traditional sense> are just not going to be 
available in the same numbers as they have been in the past. 
The National Center for Education Statistics reports that af^HOXi- 
mately 4$ million students are currently enrolled m our elc- 
mentary and secondary schools. By 1^ that number will 
drop to under 45 million. It has been dropping steadily for the 
past six years, beg inning ^ with the elementary grades. The 
decline will spread with rippie-Hkc effects through the secondaiy 
levels until it reaches the nation's colleges about 1^0. The 
enrollment gro^h at many colleges and universities has already 
leveled off during the past three years, Many institutions not 
already employing open admissions polic.es have been able to 
maintain enrollment levels by lowering admission standards: 
i.e., moving toward open admissions. Most institutions will 
survive the economic cmnch thi. will accompany declining 
enrollments. Some will not. It is expected that many of those 
which do not survive will find their students redistnbutmg 
themselves at those institutions which do. Thus, the latter wilj 
be able to maintain their enrollment at levels which will allow 
them to continue to survive. 

There is no end in sight to the declining student popula- 
tion prob^m. The declining birth rate> which accounts for the 
smaller enrollments, has not leveled off yet, according to the 
National Center for Health Statistics. It has dechitcd steadily 
from a peak of 3.76 children per woman in 1957 to a record 
low of 1 .75 for tlic year 1^76. 

Declining enrollments are going t^ force colleges and 
universities to diversify their otfenrtgs m order to attract new 
clientele. Students, other than those which fit the traditional 
mold, will be actively sought mall walks of life and at all age 
levels. Adiihs in continuing education and skills-updating pn> 
grams will be heavily recruited as the population grows older 
and the median age of the population steadily increases. 
Demographic information related to this age group and its 
anticipated needs has to be collected so that the transition to 
more and more adult education programs will be smooth and 
productive* 

Data bases related to cultural factors. Cultural de- 
velopments are going to impact with greater and greater seventy 
on the demand for the university's product, an education. 
Enrollments in higher education have begun to shnnk and will 
continue to shrink duct i^ainly, to a leveling off of 'Renumber 
of high school graduates going on to college and a projected 
continuation of the declining number of students graduating or 
due graduate in the next IS years. Other cultural develop* 
ments are also fueling the decline in enrollments. In the late 
sixties, there began to emerge a nev^ value system among a 
smalt but vociferous group of our nation's youth which saw 
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mile relevaru^e in a Lollegc education to the u>n4uct of their 
livCd. Job^ fterc, ^till arc, hard to finilt even vvith a college 
degree. A college eduuation longer autoinatu all> opens 
Jours to an interesting, stimulating, high-pa>ing job. Union 
membership ^an also guarantee high pa^ i^ith ;ob sei.tinc> 
without 3n initial heavy investment if time and money. The 
steady rise in tuition costs has placed severe constraints on the 
abilit> of the middle<lass familtes to educate their sons and 
daughters, the> aie being priced out of the market. It is 
inureasin^lj more difftualt for middle-class families to qiialify 
fui student finaiiL.dl aid. Whether this anti-collcgc sentiment 
and finanuial bunkn vvill Lonbnuc to grovv or begin to dimjnjsh 
*t\\ have a tremendous impact on the future demand for a 
voDege cduuation. danging uuJturaJ devwlopments reflected 
in the values and life st>les of our >oung people must be 
munitofed and inuorpuratcd ado siraiegiL planning models. 

Factors within the un[verslt>S oontro^. Up to this 
point, factors usuall> beyond the control of the academic 
in^ticutiun have been discussed. The next section vvtU cAplore 
the 4>iea^ normally i^lthin the control of the institution. Man> 
of these dre Llosel> associated with the capabilit> of the 
univcrsit> and the u^st-bcnefic of tt^ educational delivery pro- 
gram^k. Capabilit) is measured in terms of racuU>, support 
Maff, and eduuationeJ research e tonmcnts. Such things as 
tenure, salaries, teaching loads, unionifation, retirement, as 
vvell as age of buildings and lab e'^uipment, must all be taken 
into aceount in planning the futr ^ For cx;^mplc, programs 
^/ffered b> the institution can ben <ide available at other sites or 
discontinued entirely. If a prognini ts \o be instituted, the time 
frame vvithin ^hich it is to be introduced needs to beknovvn by 
the strategic planners. Other factors that will have to be *»on- 
sidcrcd, and for ^htuh data must be available, are. the number 
of fau jltv chat have to be hired, the student body size expected 
c^ci<tuall> to be served, cost estimates, and space requiiemcnts. 
On the other hand, if programs or departments are being 
pna^d out, the impact that \vdl have on long-range plans 
needs tj be asses^^, Tli^ same t>pe of care in addressing 
enrullnfient changes and faLtEit> rci^uircments i^ould appl> to 
part-tiiTie, mini, and nun-def e programs. 

The nc^t factor under au .emic control is the institution's 
admissions poliL>. Available data bases should be able to 
atu,^ ^ ^ue^tions like the following. Hasthwpoolofpotentiall> 
tfuaLHed vandt<iates been exhausted? Would changing the cri 
tcna for admission increase or dixrcase the pool of^tential 
sitjdcrts? llovr far tan adnilssions st/indards be lo^veied ^ith- 
rnji ^^^ing acadcm,^ standards? To what extent are qualified 
stud^iitSr including minorities, being recruited? 

Another major factor vvhich is within the control of the 
dcadeniic institution is tui'ion charges. Sufficient data should 
be collected to determine the impact that tuition increases and 
decrea^s have on enrollment. The data can be plugged into 
emulation models to estimate the revenue that VtiW be gamed 
or lost b> changes in tuition rates. To what extent does a 
luituin kUcrcase change the composition of the student bod> ? 
Are the changes desirable? 

Vet another inr^portant aspect to be considered ip data base 
building for strategic planners is tlic relevance of academic 
priigEMti;> with respect to the needs of the academic community. 
Are the courses and programs students want being offered? 
One ^va^ of ansv^renng this question is through the distribution 
of ^ocstionnairest Surveys are not onl> convenient for assessing 
the current vlim4>e but the> arc useful in directing long range 
piannwrs. Input from students can be helpfuL also, in dispelling 
^Jhe notion that administrators make devisiono while sitting in 
ih^ii ivory towers not kito^^mg what students reall> want or 
iiccd. Questionnaires distributed tu high ^hool students enable 
data WsrtK^. to be built around the educational and career in- 



terests of those who vrlW be served in tt uture. The abilit> to 
serve their interests can bt asM;s.^d a uture alterations can 
}e taken into account during t>^e plar .ig process. Participa 
tion of ti,e adult communit> thruu^h questionnaires can le^i^ to 
better planned future program* ^or those institutions that offer 
adult education. 

Data Bases Helpful in Assessing Slate Subsidies 

Information about educational planning at the state level 
also pla>s a ke> role in strategic planning. The universit> s 
educational tnission relative to the other educational institu 
tions io the state or region needs to be put into pcispectivc. 
The state's master plan for higher education, if such a docu- 
ment exists, may be useful for this purpose. What chang^;^ are 
evolving in the stale's master plan? Are the undergraduate 
programs at the universities to be phased out and graduate and 
professional training to become their raison petrel Will the 
stati. at some time in the future decide its emplo>.nfit needs 
and sei educational quotas acw^^ingl>? Will the suite go even 
furthc. and decide which of its citizens snould receive pos 
secondary education? To vvhat extent? At taxpayers expense'. 
If so» tliFOugh direct aid to the students themselves, Ahereb> 
the> select the institution the> wish to attend, directl) to the 
institutions so that the> would select the students to receive 
financial aid? DifTerent planning requirements «bould ac 
corvipany either of these altematives. 

Data Bases to Monitor Federal Support of Research 
and Development 

Govemment impact, at both the state and federal level, is 
hard to assess and monitor. Probabl> none of the large uni 
versities could operate at the level it cunentl> does without 
federal and state support. Almost ovemight, some of these 
universities with large research centers have come face to f^.e 
with a ..lajor budget cri sis because of a substantial reduction of 
federal money for support of research and the training of 
graduate students. Other national philantrophic foundations 
are uneasy about the new laws that have been passed or 
proposed that would have a direct bearing on their tax exempt 
status. Other pressing national problems of an energ>, enurun 
mental, health, and welfare nature are in need of huge federal 
appropriations to support them, a fact which ma> cut into the 
money av jilable for general support of higher educat,on. There 
is a need to have available, and to incorporate into strategic 
p\.nnir^g, information from anal>zed dau bases nl'^ich relate to 
federal support of research and de «^elopment. Information as to 
the trends, based on past funding pattems, that are useful In 
projecting future levels of funding to colleges and univw.sities 
mu^t be collected, organized, and ijiptemented in!^/ ;>lanning 
models. 

To monitor federal R&D activities, the ^' lional Science 
Foundation (NSFO> conducts a program of intramural and 
sponsored surveys of R&O spending during each ensuing 
fiscal >ear, This has resulted in an extensive collci.tion of data 
and detailed analyses of programs related to the nation's science 
andtechno1og> resources. These statistii:al data (f'ational Science 
Foundation, 1976) have beconte a useful tool in projecting 
future trends in federal R&D spending and, in turn, in formu 
lating the university's planning and budget propos^ils. 

An> number of unforseen factors can significantl} affect 
the level of federal ^&D funding. No one, for example, can 
predict which national issue on the horizon (oi bc>ondJ aiII 
stimulate sufficient public interest or debate to be transfurmcd 
into legislatio. and massive R&D funding (as was the uase 
^ith the Energ> Research and Development Administration)^ 
or an impending intematjonal cnsis which ma> alter the nation^ * 
R&D fundii^ pattem. Such unpredictable factors are be>ond 
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the scope of the data collected by NSF The data can bo 
rclatcdn. however^ to other economic variables to show their 
relationship to the level of R&D funding and to help identify 
the factors responsible for these relationships. Given such 
relationships^ the next step is to assess the extent to which 
these same factors might impact on future funding. 

Fe<ieral funding for R&D is an important !^ource of income 
at the University of Pittsburgh as it h at other colleges and 
universities across the nation. It contributes approximately 
one*fifth of the annual budget and i& subject to all the vagaries 
t^it accompany the distribution of federal dollars for R&D 
programs at educational institutions The^e monies are not 
distributed equitably or proportionate ly> or according to a 
plan* but competitively through a system whereby proposals 
for R&D are evaluated and referred^ with winner taking alLV 
There i <io ceiling on the amount any one eolJege or university 
may be awarded in a given fiscal year Since the system tends 
to reward those who have successfully completed their pre- 
vious contraet(s) and who have the personnel and physical 
resources to accomplish what they propose to do^ it is easy to 
understand why some universities come away with the lion's 
share of the R&D funds earmarked for colleges and universities. 
While it is possible to increase the university's share of these 
moniesf it must be recognized that competition in the future 
will be i;i tense as enrollments shrink and institutions of higher 
education try to make up for the accompanying dollar loss by 
increasing their share of ^deral R&D funds. Increasing that 
share cannot be approached heher- skelter To be competitive^ 
the university must submit proposals that are in areas the 
federal agencies have earmarked for research and development. 
But there is nK>re to it than that To be competitive requires a 
great deal of careful planning* an assessment of the university s 
strengths and weaknesses* and a deliberate exploitation of 
opportunities A key to this process would be an assessment of 
the direction of future funding for R&D at the federal level as 
it relutes to a given college or university. What arc the best 
bets for future R&C^ What data bases need to be organized 
and tapped to support long-range planning in this area? What 
min^'Studiest if any* need to be conducted to support this 
strategic planning activity? And what changes should be made 



with respect to program:^^ faculty* students* and research in 
order to be able to positively exploit the opportunities that will 
arise in the future? 

Data Bases Kelaled to Grants and Endowments 

The last of the four major sourves of financing for higher 
education is grants and endowments. The educational planner 
needs to incotporate into the strategic planning models data on 
current income from these sources^ as well as projections of 
future incotne. to what extent is the university relying on 
these sources? Is the level of dependency increasug or de* 
creasing? Data on the performanec level of the investments is 
needed to insure that a maximum retum is generated. The^c data » 
in tum^ can be given to a professional financial analyst for 
appraisal and recommendations. 

UdUzation of data bases for statistical analysis. Many 
statistical approaches and a number of simulation models are 
available for manipulating data for strategic planning purposes. 
There is no absolute right or wrong method, but some method* 
ologiesare better suited than others. The criterion forchoo^ing 
the best methodology is the purpose for which the results are 
intended or the questions to be answered. Futuristic trends and 
educational predictior.^ aie the main concern of strategic planners. 

Summary 

Forecasting is beginning to develop as a science. With the 
current state of technological development in data bases and 
information systems, the need to anticipate the future and plan 
accordin^'v for tt is becoming a reality m higher educatiop. 
Data ba^ s to support demographic forecasting are in the 
highest level of development* followed by economic data 
bases. Data bases ore becoming available to hdp assess the 
developing technology and the new career horizons that will 
spin off from it. There are data bases beirtg built in the area of 
'cderal funding for R&D and for federal support to universities 
and colleges. State master plans for higher education are 
belpfuL when available. Data bases to support cultural fore- 
casting, however* are primitive* neglected* and most in need 
of development. 
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Formula Finding: Ad Overview 

In Die United States, funds for publiehigheredueationaic 
generally requested and allocated on the basts of an earollment 
model or fonnula. Linking funds directly to tlie number of 
students served, given their level and Held of study, has be- 
come ^ucationally and politically acceptable. 

Allocation formulae m most states represent an improve* 
ment upon earlier allocation models that relied primarily on an 
analysis of per-student appropriations. These earlier allocation 
models were themselves an improvement over the preceding 
allocation method based on presidential lobbying funds. 

Objectivity, equ'i^, and simplicity arc strengths that diose 
favoring formula funding attribute to this approach. Formula 
funding has helped minimize political warfare and open com- 
petition among institutions for scarce funds. An appropriations 
formula provide stale officials with a simple and understand- 
able ba^is for deciding upon institutional requests for appro- 
priations. Equivalent support for equivalent programs is wide- 
ly understood as the rationale for a formula approach to funding. 
Most formulae recognize the number of students enrolled and 
the mt?c of educational programs by type and level. 

Soon after fundir^ fcrmulae were implemented, however, 
criucisms began to surface. Prominent criticisms incltjde charges 
about appropriations formulae: 

1 . They arc inclined to impose a levelii^ effect upon die 
quality of educational programs. The use of average costs ^ 
formula insmictional rates tends to homo^nize instiiutional 
diversity. The costs of an e^cceptional academic offering are 
avcrag^ out by the costs of typ' 'H offerings of the same 
course by (^r state institutions. Progr^ans funded to be 
identical arecont^ually reinforced to be Identical reg^Iess of 
the clientele served or the special character of the institution. 

2. They pre ide no incentive for improved instnictional 
performance. Insmictional rates are the same regardless of the 
effectiveness or ineffecri'/eness of insmictional performance. 
The emphasis is on quantity rather than quality. 

3. Ihey encourage a displacement of institutional goals. 
The goal of serving students is displaced by the goal of obtain, 
ing more students. Formulae lend to become ends in dicmselves. 

4. They tend to utilize a linear approach which fails to 
recognize both economies of scale and plateaus of fixed or 
marginal costs. As a result, formulae are great during periods 
of enrollment growth since unit costs decline while revenues 
increase* 

Coupled with these cdticisms is die possibility that formula 
funding is ceasing to be an acceptable public policy. Hcpcfully, 
acceptable public policies express societal values. From the 
late fifties until the early seventies, higher education was 
growing, and society wanted to encourage this growth. As an 
acceptable public policy, formula funding reflected society's 
willingness to support higher education's growth. Today, how- 
ever, the public no longer sees the growth of higher education 
as a virtue in itself. As a result, a poTicy of funding public 



higher education solely on an enrollment basis may be viewed 
as out of harmony with die wishes of society. 

Performance Funding 

Like many other states. Tennessee employs an appropria- 
tions formula for public higher education that derives major 
cost projections from a credit hour matrix l^y level and field of 
study. Formula guidelines are also provided for general admin- 
istration, maintenance, and operation of physical plant, student 
services, and libraries. 

The Performance Funding Project is an attempt on the 
part of the Tennessee Higher Education Commission, a state- 
wide coordinating agency to improve the cunent appropria- 
tions formula in Tennessee. Underwritten by grants from the 
Fund for the Improvement of Postsecondaiy Education, die 
Kellogg Foundation, and ^ Ford Foundation, the project 
represents a response to criticisms of the current formula and 
an opportunity for higher education to denwnstrate publicly 
the effectiveness of instructional performance. 

The major purpose of the project is to explore the feasibil- 
ity of allocating some portion of state fundson a performance 
criterion, as compared to allocating funds solely on an enroll' 
ment criterion. The project assumes fundir^ wilt continue to 
be primarily on an enrollment basis but that a complementary 
feature might be built into the formula to promote institutional 
diversity and improved instnicdonal performance. 

Any alteration in funding policy must meet certain hound* 
ary conditions. Changes to the current allocation formula de- 
signed to promote efTective performance must accomplish the 
following; 

1. They must be politically acceptable (i.e. .easily under* 
stood and accepted by legislators and member of state govem-^ 
ment). 

2. They must be professionally acceptable (i.e., striking 
the right balance between the need for institutional autonomy 
and tl>e med for state-level review). 

3. They must encourage institutions to exercise inltiauve 
in developing performance measures on which they might 
eventually be funded. 

4. They must recognize differences in instinitional role 
and environment and promote diversity. 

The Performance Funding Project is completing its third 
year. The first two years were spent involving national and 
state-level higher education authorities in clarifying die con- 
cepnial base of the prqject, identifying related efforts underway 
around the country, outlining procedures for executing die 
project, and obtaining the necessary support for pilot projects. 

The ^tnl year has been devoted to pilot project ^ictivity. 
Wc decided early in the project to involve as many campus 
individuals as possible in thinking about altering finding policy 
to include performance as well as enrollment criteria. One 
reason for this decision was a belief that those individuals 
potentially affected by such a policy ought to have ar« c^)portu- 
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nity to help shape that poUy. A sei^ond irason ^^4S the belief 
that having d^ftirian^ individuals a& po&^ible working on sui^ha 
complex policy issue would be advantag^us. 

fn the spnng of I976> Tennessee public colleges and 
universities ivere invjied to subnur preJiminai> pn^po^J^ for 
pilot projects that Mvould ultimately result in a modA for 
allocating some portion of state funds to their institutions on 
the basts of performance. Asa result ofthese proposals* eleven 
public colleges and universities — two ref^earch universities, 
six regional universities* and three community colleges— were 
selected to develop pilot projects Pilot projects extend over 
two years — calling in the first >'ear for the development of 
institution-wide instructional ^oals and associated indicators 
of performance and in the :>econd year for the acquisition of 
data on these perfonnance indicators and the exploration of 
funding poW that might promote and rewa. ' effective per- 
formance. 

Pilot projects vary in their approacht emphasis* level of 
sophistication and background of project director, but they 
share a common set of expected outcomes At the end of this 
first project year, each participating institution has been con- 
tracted with to produce (a) a set of institution -wide instructional 
goals, (b) a set of corresponding perfonrtance indicators, and 
(c) a report on how those goats and indicators were achieved 
Some projects are using the Institutional Coals Inventory to 
reach consensus on institution -wide instructional goals Otliers 
are employing elaborate committee structures to arrive at In- 
structional goal statenfients. Still others are using existing 
institutional goal statements as a vehicle for reaching con- 
sensus. The primary basisof some projects is in the faculties of 
the arts and sciences. Other projects primarily reside in profes- 
sional schools. Two pilot projects represent attempts by pro- 
fessional schools to develop performance fundng models that 
could be replicated throughout their respective instituttons 

Pjfot project directors share a common set of expectations, 
and they join the project staff in sharing a common set of 
challenges. Any effort that explores the possibility of linking 
two difficult problems — funding policy for pi:blic higher edu- 
cation find assessment of instructional performance— demands 
great care and humility. The project rests on a number of 
debatable assumptions: 

1 . A complement to the current allocation formula could 
result in improved instructional performance (i e . thai the 
behavior of a public sector agency can be affected by economic 
reinforcement). 

2. Instructitinaleffectivcnesscan be measured in terms of 
student outcomes. 

3. Some instructional outcomes can be quantitatively de- 
scribed. 

4. Acceptable measures of institution- wide instructional 
performance can be developed or identifiec' and agr&.'d upon 
by both institutions and a statc-Jcvcl agency 

5. In a society witJi diffused aims, an instimtion can 
reach consensus on its fimdamental purposes and make them 
explicit. 

6. Instimtions fare better when their purposes are explicit. 

7. Rewarding a public sector agicncy for effective per- 
formance would be acceptable public policy. 

8. Pterfoimance funding should reward achievement rather 
than process. 

9. f^rformance funding should be for demonstrated per- 
formance, not proposed or promised perfonnance. 

10. Current allocation fonnulac impede instimtional diver- 
sity. 

After some time, debating Uicse assumptions became 
countciproductivc. The formula was not being improvcdt and 
legislators were continuing to ask hard, unnnswercd questions 



about the effectiveness of higher education. Progress in im 
proving the formula or assessing the performance of higlier 
education seemed unlikely to emerge from a rehearsal of the 
difficulties associated with such efforts. As a resuitt we pro- 
i^eeded ivith pilot p/oject activity, assuming it wasbet^e/ to act 
on a set of intperfect assumptions than to wait until there 
agreement upon a perfect set of assumptions 

Lessons Learned 

Dunng the first year of oilot project activity, a number of 
lessons were learned whili; explonng me feasibility of funding 
institutions on the basis oi performance. 

Lesson 1. Perfonnance funding is a difficult concept to 
communicate. It has been misinteipreted in a variety of ways 
(e.g., funding of innovative approaches to mstniction, funding 
for special institutional activities). 

Lesson 2. The possibility of statewide indicators of insti- 
tutional perfonnance is an anathema to campus personnel. 
Early in the project there was discussion of the possibility of 
developing a set of statewide indicators gainst which all in- 
stitutions could be assessed. One campus adminii^or pointed 
out. thoughi that statewide indicators of performance would 
^^average out'' institutional i<£entity> just as the current formula 
supposedly does» since every institution would be assessed by 
a common standard. 

Lesson 3. While campusesareicluctant to consider state- 
wide performance indicators, they remain alm'^jt equally sus- 
picious of campus^based indicators. This suspicion grows partly 
out of a concern that c am pusKteve loped indicators will not be 
equally ngorous. One faculty committee working on the Per^ 
formance Funding Project asked why it should develop ngorous 
instructional goals when anotiier institution might select a 
straw-man approach to goal sening and be rewarded more for 
less achievement. Suspicion also grows out of a concern that 
one department or college be singled out as solely responsible 
for certain instructional goals or outcomes (e.g., English depart- 
ment for communication competencies, philosophy department 
for critical thinking cor.petencies). 

Lesson 4. Faculty and administrators (ire concerned about 
the unintended outcomes of a funding policy that would include 
perfonnance criteria. The possibility of punitive funding (i-e.* 
bccattseofpoorperformance^ receiving less than one would on 
an enrollment basis^ is a concern that conUnues to be expressed. 

Lesson 5. Getting faculty to think in terms of institution- 
wide goals and indicators is difficult. Individuals speak with 
ease about departmental goals and indicatorsi but arriving at 
goals and indicators that cut across departmental lines is another 
matter. 

Lesson 6. Our desire for institution- wide instructional 
performance measures currently exceeds the teclvucal capability 
of the assessment community. However^ several developmental 
efforts by the American College Testing Program and the 
Educational Testing Service look promising. 

Promising Finilings 

Coupled with some difficult and sometimes painful lessons 
learned during the past year have been some promising and 
encouraging findings. 

1 . A great deal can ^ accomplished for relatively few 
dollars. For less than one hundred and TiAy thousand dollais, 
eleven institutions have undertaken a serious took at their 
instructional goats and effects on ^nidcnts. 

2. Faculties across Tennessee arc very concerned afK>ut 
instructbnal performance. They sense that funding solely in 
terms of number of studtjtts served has caused people to 
prostitute academic standards. 
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3 Addressing the question of what constitutes efTecflve 
instnictional pc/fonnance has ted to a sciious consideration of 
what constitutes minimum competence for a college degree. 
This became the focal point of a statewide fonim^ sponsored 
by the Ford Foundation* on miPimalF essential skills and 
understamlings that all college students ought to possess. At 
two institutions the development of instructional goals and 
associated indicators is centering on assuring certam minimal 
instnictionaJ outcomes. 

4. While some common goals and indicators are einefging 
from pilot project activity, sets of goals and indicators seem to 
be taking on a unique character at each institution. 

5. The Performance Fundrng Project is causing hundreds 
of facijjty members and administraton to take a serious look at 
the effect they are having on students. 

6. A number of solutions have been found to questrons 
that plagued the project in its initial stages. For instance^ iiow 
can you iiave equal rigor in the assessment of achievement of 
goaU when goals and perfomiancc indicators differ from campus 
to campus? One possibility would be to have a board of 
visitor^ provide an assessment of each institution's performance 



against its set of individually developed instructional goals. 
The assessment coutdt in turn* be translated into a factor to be 
use<l in allocating some small portion of the state allocation. ' 

Hopes for Next Year 

Completing the first year of pilot project activity means 
each participating institution wilt have a set of instructional 
goajs and a means of assessing performance on those goals. 
The second year* which involves gathering performance data 
and suggesting a means for incorporating performance measures 
into the current formula, presents an even greater challenge. 

remain undaunted, howeverr in our optimism about what 
the project may achieve. 

Questions continue to haunt us. Pobting out problems is 
far easier than finding solutions. We continue* thougii) on the 
conviction that* at wcxsIf we have brought people together 
across Tennessee to grapple with the issue of instructional 
effectiveness, and, at best, we may have come across a policy 
for funding a public sector agency on some basis other than 
an analysis of activity. 



Footnotes 

number of hypotbedsal posstbihiidi for funding tm ^ perionnarKc baiii arc <™»l»ned txxCas^SittdustnFtrfvrmarKtFundtng. available i*pon (C<tudsl from <lwTdnMM*c 
Higher lidiKaiwa Oimmtistoa 
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CALCULATING THE ECONOMIC MULTIPLIER 
FOR LOCAL UNIVERSITY SPENDING 



Charles Salley 
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Economic impact studies have become a popular vehicle to 
promote the positive attributes of nonprofit institutions for the 
local area Over the past few years, institutional researchers 
have prepared a scries ofsueh studies eaHtng attention to the 
extra dividend of jobs and income that a university provides its 
local community incidental to its primary educational and 
cultural contribution. 

Successive studies resolved numerous conceptual problenis 
dealing with the ways university spending initially enters the 
local income stream However, estimations of university-related 
direct spending do not complete the pietureof the influence on 
local economic activity. Because of the interdependence of a 
high consumption, mass-pixxluction economy* every dollar of 
final goods purchased provides a flow of income to the entire 
chain of activity that providesthese goods. Sincedircct purchases 
rnduce additional rounds of spending, the university's total 
economic impact is some multiple of university-related initial 
spending* 

Institutional researchers have usually presented this con- 
ceptual basis of the community multtplicr^ but they have rarely 
presented an actual calculation of the multiplier value sutv 
scqucntly used Instead, the value is usual!) taken from some 
more general study of tr^e areas or similar size. This lack of 
precision in estimating the muhiplier value often eonrpromises 
the considerable effort expendeil to measure accjrately the 
amount of dircd university related spending. 

Hie present study is a model for institutional researchers 
that Illustrates specifjc means not 6n\y to conduct sample 
surveys of faculty and student spending but, also, to calculate ^ 
multiplier value of induced spending for the specific community 
where the university is located. 

The model uses locaJ value-added figures calcubted from 
spending survey results and from readily available county 
census data Formulas are translated into a stepwise calculation 
procedure that enables the researcher to arrive at a reliable 
economic impact estimate without spending many weeks re- 
viewing the region:?! science literature The muhiplier calcula- 
tion avoids both the massive data requirements of input -output 
models and the oversimplified structure of aggregate location 
quotient models. 

As a working cKample, the study estimates the spending 
impact of a large public urban university on its metropolitan 
area, 

Previous Impact Studies 

Economic impact studies of colleges and universities first 
appeared in the mtd 1960s Table I summarizes the eon^ibu- 
tions of thirteen representative studies published from l%4to 
1976. 

From the initial study forward, all have regarded the 
university as an export scctur of the local economy. Tht.^ is 
because most of a university's income and most of its students* 
income originates outside the community, To the extent that 
these funds from nonlocal sources ^ spent locally, the uni- 
versity provides community income very much l:kc a local 
factoiy exporting manufactured goods to other areas. The 



university sells educational and research services to outsiders^ 
although consumption takes place locally, Hius the university 
exports educational services in the same sense as a Florida 
resort exports services to winter vistors. 

All of the studies estimate die demand for goods and 
services in the community resulting directly from expenditures 
by the university and its faculry and students. The Husson 
G)llege Study (Vizaid, 1967), thought was the first to use eco- 
nomic analysts to measure the secondary spending induced by 
the university's initial direct spending. Hie concept introduced 
was economic base theory and the local multiplier. 

Hie underlying idea of economic base thiioiy is regional 
specialization. Hie division of Jabor* and a corresponding 
degree of specialization, Uaprominentcharactenstieof advanced 
economies. Great increases in productivity result when partici- 
pants in the economy concentrate their productive energies in 
specialized activities where they have natural or trained abilities. 

Similarly, geographic areas often contribute to increased 
productiviry through specialization. The specialization may 
result from some indigenous talent of the local population or 
from a local endowment of natural resources such as soil or 
minerals. Specialization may also be the result ofa location that 
has particular relevance to a market area or that serves as a 
transportation center or transfer point, sa> Jrom water to rati or 
other land transportation. 

An area's economic base consists of these specialized 
activities that produce for a demand that exceeds local consump* 
tion, that is, activities (bat involve sales to firms located 
elsewhere (North, 1955, Tiebout^ 1962), Such activities pro- 
duce an inflow of money income from nonlocal sources. A 
portion of the nonlocal income then makes its way as wages and 
purchases into local trade and service activiry. 

The University of Florida study (Cook* 1970) pointed out 
that an initial difficulty with the cxport*basc concept lies in 
properly classifying basic (export) and service industries. The 
study examined the argument that the number of university 
employees attributed to the base sector should be limited to the 
ratio of funds from nonlocal sources to total university funds. 
For instance* if only eighty percent of the university's funds 
come from nonlocal sources, only eighty percent of the uni- 
versity's employment should be considered basic. Conversely, 
the study pointed out» if local expenditures for education would 
he spent elsewhere in the absence of the university* then local 
educational services represent a decrease in the community's 
imports (import substitution). Hius, all local university spending 
and employment inay be classified as basic. 

'nicldahoStatcUniversitystudy(Kclly& Peterson, 1971 j 
raised the question of correct sample design for the surveys 
needed to estimate the funds students and faculry spend ^ally. 
Whereas their study estimated the level of studem spending by 
surveying class sections selected randomly^ previous studies 
had drawn a random sample of individual students. Wtlson and 
Raymond (1973) suggests that a proportional, stratified s,implc 
produces a less biased estimate of the population's spending 
than other methods. Table 2 illustrates this method use** to 
estimate local faculty/staff spending from survey results.^ The 
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Table I 

Summsiy Characicri sties orPr.jvious Impact Studies 



Institution 


Major 


Major 


(Jsc of a 


and year 


contributton 


shortcoming 


multiplier 


vnivcioiijr ui Dnugcpon 


nvtUKlH^Ca lilt ^Apuit naitlVe 


V-OlOluCrS' vllljr UJf CM t AptiiU I (-Ui-^ 9 VI 


Ko 


<1964) 


services 


university 




nvriJicni iviicriigan 










of goods 


university 






(viAKca use muiiiiJiiti [u CM.iiTi4ie 


rVvpiLrntiAii rtf miillinlicr nnt cfv^ific 

L^Vf IV4I Lull vL lilUI^L^ILVI 1^ IIVI- ^M^^VIIV 


Yes 


(1967) 


induced spending 




(2.0) 




^Artc-krlAsw- inrii 1 Lj- i II 1 tnt il '■nal'lidC tub* ni*tnM'^. 


lunrin^ icullt^fvt C^Hh^K f>f cttt^lAnl Cfv^n^lti# 
ij^iLNta jimuwu vj-j^vts- vi MUUCl'l- vuvi-hj vjik 


Yes 


(1968) 


it as too costly 




(1 37) 










(1969) 


employment 






Univer$Uy of Rcnda 


Justifies ^11 university employment ^ b^ic 


1 

Basic employee equivalents of student 


ICS 


(1970) 




spending aie biased upw^^if 


(14) 


Wisconsin State University 


Estimates future impact based on enroll- 


Derivation of inuUlpli^i u- not specific 


Yes 


(1970) 


ment projections 




(2.0-2.3) 


Urn vers iiy of Alab^^ 


Illustrates tlp^^afd bias of aggregate em- 


Ptoduces unusually high multiplier resulting 


Yes 


(1971) 


ployment multipliers 


from aggregate approach 


(4.35) 


Idaho State Untvmuy 


Makes first attempt lodiSaggregate student 


San-plC design leads to considerable bias 


No 


(1971) 


spend 11^ 






Eastern Kentucky Univeisity 


Makes first use of stiulent spending Jianes 


Denvatkm of mutuplier is not specific 


Yes 


(1970 






(L75) 


University or Pittsburgh 


Uses comprehensive data collection 


There IS no independent estimate of multi- 


Yes 


(1972) 




plier 


(2.0) 


Kent Slate University 


Uses speeifk calculation of university 


Assuntcs university multiplier and service 


Yes 


(1973) 


sector multiplier 


sector multiplier are same 


(1.09) 


GcoT]gia State University 


Uses specific calculation of alternative 


Docs not consider negative lax impact or 


Yes 


(1976) 


multiplier models 


positive human capital impact 


(1.22-1 78) 



Table 2 

Estimation of Local Faculty/Staff Spending 
Stratified Random Sample 



Percent distribution 





FuJI-time 


Part-time 


Full-time part-time 




faculty 


faculty 


staff staff 


Population (3305) 


23.9 


S.2 


33.3 34.5 


Samplc<M08) 


3S.S 


6.5 


38.8 15 9 


Spending category 




Sample annual averse 


Weighted annual average^ 


Kousiiig 




$3523.00 


S2280.% 


Utilities 




717.36 


627.96 


Pood and houshold 




I7*M 12 


1576.68 


Eating out 




555.36 


513.72 


Entertainment 




307 80 


28^.24 


Automobile 




1205.04 


1 052.64 


Other transportation 




75 00 


75.4» 


Clothing 




501.84 


391 80 


personal service 




2S0.32 


244.56 


Health services 




524 64 


429.95 


Pumiturc 




318.36 


246.24 


Other 




SOI .84 


690.96 


Total 




S9604.68 


W 19.20 



'^^Cightrng tAivtx JiPC itw i^tur^ vl l«tiili]r^Mjff pufHiUhun ine^^h MraiJiL^iign i^ihc pupu^d»Mfl cotal, i e , 23 9*^ for U\\ nok likruJijr, S 1% fvi prl tifi» favuh^. eiv 
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same procedure is used io csiimatc local spending b> the 
student population. 

Multiplier Estimation of Induced Spending 

The ^(udtes whjch calculatetl a multiplier value approached 
the problem in a conceptually tdendcal manner (Billings. 1%9) 
while Peking iiKreastngly accurate rnethods of calculation. 
The bimplestmodel drawn from this literature views the amount 
of induced spending as proportionate to the ratio of base sector 
employment (or ^^pending) to total employment (or spending). 
Thi& aggregate location <luotient multiplier is easily cakutatcd* 
but Jt haik Ehe drawback of usinga single multiplier for all sectors 
of the local ceonomy. However* individual sectors of the local 
ei'Onomy may well have different proportions of locaJ/non local 
&pend}ng. If this is the case* each sector would then have a 
different income anif employment effect on the local economy. 

The assumption that all sectors have the same proportion 
of local spending can lead to great overstatement of economic 
impact, especially in rapidly growing areas where the base 
sectors are shifting. Using this method* some studies calculated 
multiplier values as high as 4.35. 

To overcome this drawback, the Kent Stale study <Wilson 
Sl Raymonif, 1973) suggested computing a multiplier speoific- 
alfy for the university portion of the export base. The multiplier 
ts computed from the local value added of various sectors in 
proportion to university spending in each of these sectors. 
However, even though this model more f'ccurately computes 
the initial local spending impact peculiar to the universityi it 
suffers the drawback that subsequent respending by all local 
consumers is presumeif to have the same pattern as the university, 

A third type of model, a differential value-added multiplier 
(Brevier, 1974). isarcfinementof the KentStaic model Asthe 
name indicates^ two different multipliers come into play— an 
initial local spending ratio unique for university patterns and a 
second ratio To*' subsequent rounds of local respencfing by 
consumers. 

The limiting case of this type of disaggregation i the 
input-output model which uses separate spending ratios for 
every sector of the local economy The Bresler model represents 
a happy medium by recognizing that, while the initial spending 
impact of a university may differ substantially from the initial 
impact of, say* an automobile assembly plant* the induced 



responding by vanou^k local consumers may be more similar 
and» thus* more reliably aggregated. 

The model first estimates the initial university-related 
spending ratio based on the pattertt of local university pur- 
chases As Table 3 shows, the local value-added figures used 
in the computation are calculated from steadily available local 
payroll/sales data The second ratio* local respending by con- 
sumers* is simply the value-added (payroll/sales) by local 
trade purchases. 

This approach takes account of the university's unique 
initial spending pattern while avoiifing the immense data re^ 
quircments of a full input output model that has separate local 
spenifing ratios forevery sector. Table4 sho^s how tocompute 
the final multiplier value as a combination of the local value 
added inital university -related spending and the local value- 
added by induced consumer respending. 

Conducting the Impact Study 

The estimation of the university s economic impact pro- 
ceeds in five distinct phases: 

1. Collection of university enrollment, payroll* and pur- 
chasing data 

2. Survey and estimation of j^udent spending 

3. Survey and estimation of faculty/staff spending 

4. Calculation of the local mulnplcr 

5. Computation of the university's total impact on local 
Income.* 

In the study of Georgia State Unwersjty s impact on the 
Atlanta area economy, the Business Office provided Mate funds 
expenditure data for the fiscal year 1976. The purcha^ng data 
which ^^as initially classified $y university expense code was 
regrouped to correspond to ihc Standard Industrial Classification 
(SIC) used by the Department of Commerce. This was necessary 
because virtually all Department of Commerce local payroll/sales 
(value-added) ratios are published only for the SIC code industry 
groups. 

The Business Office also provided gross and net payroll 
figures for the fiscal year for full- and part-time employees. The 
number of employees by category and the number of students 
by category came from the Office of Institutional Planning. 

Next« the Office of In^itutional Planning conducted ques^ 
tionnaire survcysof student spending patierni ami of faculty/siaff 
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Table 3 

CaJcutaiion of Initial Impact by Universiiy Purchases 
Using Local Value-Added Ratios' 



Amount of Industry Value-added Value-added 
hem locai purchase SIC code ralio*^ aitiounl (2) x (4) 

Employee travel 



ami benefits 


S J20,977 


7000 


.322 


S 103.355 


Taxes and ut titties 


1,506,241 




.39/^ 


S 597,978 


Trade purchases 
(wholesale and [etaiD 


JJ98,829 


5000 


J33 


S 425,444 


Finance and insurance 


44^1 


7300 


.366 


16,134 


Rental 


750,617 




219^ 


164,385 


Repair servtces 


6IL436 


7600 


^ .372 


227454 


Business services 


668,156 


7300 


366 


244,545 


Vehicle repair 
and service 


20^16 


7500 


.219 


4493 


Other 


IS, 119 


5000 


133 


2410 


Total 


$7JJ8,952 






SL786J98 



^Adapted ffcwn S R Brc^kr, Multipltcf for 3 Public Pirogi^, unpublished di^semtion, Georgia Slate Umvemiy, 1974^ pp JS-'J? 
'^AibDla sales-payroll rafioi arc calculated from datq prescftiw) in Ctttsut of Buiintts, U S Department of Cwnnicree 1967,5. {Il Table 4 
Wilson, Economic tmpaqt of a UDiveciiiy on the Local Economy, unpublished dissectaiion, Kent $t*ic Univeciiiy, pp I4S and 153 



Table 4 

Computation of a Differentia] Expendituic Multiplier 
Using Local Value-Added" 



m ^ 1 + ^ 

I ~s where r = initial spending 
s = le-spcnding ratio 



A. Computaiion of r, the proportion of total Georgia State Unlvefsity spending that is spent locally. 

1 . Local consumption by full-iime employees (survey) S]5,937 J67. 

2. Gross payroll to full-time focal employees S30,642,237. 
3* Portion of payroll ipeni locally (1) (2> = .520. 

<pn>:cy for all local payroll spending) 

4. Value added by university's local purchases (Tabte 3) $l,786a98. 

5. Initial local income geiK^rated by purchases (3) K (4) = $928*823. 

6. Total initial local spending (1) -)- (5> = $f6^865.990. 

7. Total university spending (all purchases 2) S37 ,781,189. 

8. Ratio of local spending to initial lotal spettdi^g (6) (7) = .446. 

B. Computaibn o(s, secondary local spending ittduced by initial local spettding 

9. Local value added by total local spcndii^ (6) x (.133*^) « $2,243,177. 
to, Irtduced local spending (9) x (3) » SI, 166452. 

11. Ratio ofimluccd local spending to initial local spending <I0) (6) .069. 

C. Computation of muhtplier. 

12. 1.000^(I!)-.93L 

13. (8) (12) = .479. 

14. 1.000 + (13) = 1479. 



'Adapted from S R Bic»tcr, Multiplier for a Public IVcv«am» unpubti^twd dtsxauton, Ccorigia Slate UDivc^iiy. 1974, pp J3-4d 
pUfchaM* Vitue added. Tabic 3, cot (4) 
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spending patterns A ran^Eom sample of the sludem bod> pro- 
duced L2 10 complete responses and a 100 percent f^icultyslafr 
survey produced I.IOScompleteresponses Population c«^IimJles 
were then calculated from these results using the stratified 
sample method illustrated in Table 2. 

The local multiplier value was then calculated. The calcu- 
lation proceeds in three steps <a) the pa>rol]/safes ratios uiyed 
as proxies for local value-added is ealculated from censusdata, 
<b) the inital impact of local university purchases is cakufated 
using the value-added figures obtained in the first step (Table 
3). and <c) the aetual multiplier value ean then be calculated 
using the local purchase impact figure from the second step* the 
gross payroll figures obtained from the Business Office* and the 
results of the faculty/stalTspendingsurvey. Theexact calculation 
using OeorgiaState University dafa is prcMsnted tnTable4. The 
calculated multiplier value for Atlanta is 1 48. This value is 
within the 1 20 to t 50 range that the American Council on 
Education recommends for university economic impact studies 
^Caffrey Isaacs* 1971), 

Finally, the total impact of the university's spending on 
local income was computed using thecalculatedlocd multiplier 
value. As seen in Figure I, the university's initial spending 
impact comes from three sources: local purchases by the uni- 
versity, local faculty /staff spending of the university payrolL 
and local spending by studen[s whose activity in Atlanta is 
directly attributable to their eruollmcn tat Ceor:gjaState University 

Local purchases by the universi[y during fiscal 1976 
totaled 57. 1 38.952 This amount is virtually the total of all pur- 
chases since the university is located in the regional wholesale 
supply center and very few purchases are made outside the area. 
Purely nonlocal initial purchases arc limited to periodical 
subsCrip[ions and some travel expenses All local orders* of 
course, do not produce additional local income if the actual 
materiaK are manufactured elsewhere The local value-added 
ratios correct for this income leakage 

Annual local spending by faculty and staff members was 
estimated to be an average of 58*419 Total local spending by 
I. full-time employees is, then, 515*937 J67. There are an 
additional l,412part-iimeemployees Although their spending 
patterns arc similar to full-time employees^ their local purchases 
cannot bc attribu[ed entirely to the university since payroll 
records indicate that only 51 *O25,208 was paid out to part time 
personnel Mostoftheir income, apparently, derives from other 
sources. 

The third source of iniiial impact is student spending 
Annual focal spending by students wascstimated to be 56*455.44 
on average Since many students are professionally employed 
in Atlanta and are incidentally enrolled in Georgia State Uni- 
versrty on a part time basis, all student spending is not directly 
attrihuiahlc to the university Questionnaire responses, though* 



Lndicatedthat46percentof the student body lives in the Atlanta 
area largely because of enrollment in Georgia State University. 
Either students have moved to the area to attend this school* or 
they would have moved elsewhere to auend school if Ceorgta 
State University were not located in the Atlanta area. A total of 
8,782 students fall in this categoi>.'n)eirsperKlii^ is $56*691*674. 

Initial university -related spending from these three sources 
totals$79*767*793. The figure is conservative because ii omits 
spending by pan-time employees and most part-time students. 
To obtain the total loc^l expenditure figure* the amount of 
initial expenditure is increas^ by the local multipher: 

$79,767,793 x (1.48) = $118,056*334. 

Con elusion 

During the 1960s and early 1970s* eeonomie impaet 
studies became the vchiele to promote the positive attributes of 
nonprofit institutions for their local areas. Postsecondaiy cdu* 
cational institutions were prominent among these^ A series of 
studies appeared calling attention to the substantial dividend of 
jobs and income the university provides as local community in 
the course of pursuing its pnmary educational and cultural 
atms. 

Succeeding studies resolved conceptual problems dealing 
^^ith the manticr in which university -related spending ^nteisthe 
local income stream. Three channels were identified: direct 
university purchases* the university payroll, and, peculiar tothe 
case of educational institutions* spending by the student body. 
The series of studies also resolved problems related to accurate 
estimation of the extent that faculty and staff spend payroll 
funds locally and the amount students spend locally. 

Developing accurate methods to estimate these ehannels of 
direct university-related spending did not complete the picture* 
however. These initial purchases induce additional rounds of 
local spending. Consequently* the untversity's total economic 
influenee is some multiple of the level of direct spending. 

Most of the studies reviewed in this paper approached the 
problem of multiplier estimation in a conceptually identical 
manner although each sought to achieve an increasingly accurate 
method of calculation* All employed the concept of the com- 
munity economic base who.se initial income tnduccs several 
rounds of additional local spending. This study illustrates the 
use of differential value-added multiplier model to estimate the 
economic impact of a large publie urban university on its 
metropolitan area. The model incorporates an initial local 
spending ratio unique for university pattems and a second local 
spending ratio for subsec]uent rounds of respending. Using this 
model to compute the actual muUiplier vahie will help the 
institutional researcher avoid both the oversimplified structure 
of aggregate location quotient models and the massive data 
requirements of a fully disa|[greg^tcd input-output model. 



Footnotes 

tit the survey que^tionruij^c^ jikI ^bc Mutfcnt ^pcnJm^ cviint^tc <tia> ^ otttJincd from ihc juihor 
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To judge from its pubjicity, ziero-based budgeting ha^ 
bei^ome mu^h a part of Washington neMvs covemge a±> 
human rights and the energy cnsis. The Wall Street Journal 
reports that, in Jate Jdnuary, Peter Pyhrr^'i £>ook on zero-based 
budgeting reached the WoJ^hi:.^ton post*s list of non fiction 
best sellers. The concept has been much covered in popujai 
periodicals^ sueh as Business Week, and has been the subject 
for hearings before the Task Force on Budget Process of the 
U House Committee on the Budget^ The subject has even 
dented the provinciality of the Aiianta Constitution. 

The popularity of a relatively ne^^, but obscure, budgeting 
procedure is attributed to the election of Jknmy Caner, the 
former govenror of Georgia, and his stated intention to apply 
zero-based budgeting across the board in federal 4genues^ As 
much as many proponents of zero-based budgeting v^ould 
Contend it is merely common scnse» it is nonetbetess an elaborate 
proce^ in budgetary justifieat ton. Yet, recording to the Wall 
Street Journal (Large* 1977) zero-based budgeting is used by 
many major companies and multinationaj corporations. Testi 
monlaJs arc freely given to the advantages atxruing from the 
application of zero-based budgetings and no less an authority 
than Arthur Bums> chairman of the Federal Reser%e Board> 
indicated some years ago that the adoption of zero-based 
budgeting coujd be a significant fai,tar m thcuontrul of govem 
mental expenditures. 

The arrival of zero-based budgeting js dated from Peter 
Pyhrr\ article in Harvard ^^^^^^^ Rewey^ (J970)and from its 
adoption by Jimmy Carter Mvho had just then been elected 
governor of Georgia. 

The purpose of this paper is to discuss liie reaettons to 
zero*based budgeting in the state of Georgia as it pertains to 
institutions of higher education. Few assumptions will be 
made about the success or faijure of zero-based budgetmg in 
uorporale industry or in federal govemment. Some ^keptiusm 
might be expressed, hov^ever* about the apprc^natcness and 
implications of zero- based budgeting fur i^lfcges and umver^iiies. 

The Georgia Experience in State Govemment 

The experience of state agencies in Georgia v^ith zcru- 
based budgeting has been examined by George Mmmiei and 
Roger Heimanson U976j. They report data collected m 4 
survey questionnaire sent to 39 budget anctl/^is who vvere 
involved jh zero-based budgeting. The study also in<.luded 
follow up interviews with ^^cKxtcd depaitn^nul budget analysts 
and with selected department heads (as well as with foimer 
governor Jimmy Carter). 

Although these investigators f^^und a generally favorabje 
attitude toward zero-based budgeting, there are ;>cveral findings 
that rc<|uire interpretation. For example^ the majority of budget 
analysts believe the quality of management information gathered 
under £ero-bascd budgeting has improved slightly or subsian 
tidily, but they do not believe zero-based budgeting has resulted 
in a Significant reallocation of the state's financial resuurcesp 
A majority reported that zero-based budgeting increased 
considerably the time and effort spent m budget preparations its 
first year. Alter inipJementation, zero-based budgeting requited 



much greater, or slightly morei time than the previous in- 
^rementaj budgeting system. Respondents are in less agreement 
about the amount of involvement zero-based budgeting re- 
quire of the agency head and its first line supervisors. Although 
ageni^y heads tend to be more involved with zero-based budget- 
ingf first line supervisors are clearly more involved than they 
were in the previous ineremenlaj system. 

As wouid be expected^ perhaps* the majonty of respondents 
m the survey did not feel that the budget bureau had done 
adequate advanced planning for implementing zero-based 
budgetings nor that adequate cost data had been available to 
the respondents to enable them to prepare decisiorv packages 
properly. They did feel, however^ that they had received 
adeijuate instructions during the first year of zero-based budget- 
ings that they now had the information needed^ and that 
adequate cost data to prepare 4 decision package were now 
available. 

Minmier and Heimanson note three primary advantages 
to the implementation of zero-ba^ed budgeting m Georgia. 
( I > the establishment of a planning phase pnor to the budgeting 
phase itseifs H) an improvement in the qaaiay of resultant 
management information* and (3) an increase in the involve- 
ment of personnel at the activity level in the state's budgeting 
process. Minmier and Hermanson ^iKludc that the major dis- 
advantage associated with zero-based budgeting is the increased 
time and eHbrt required fo* budget preparation. On balance^ 
zero-based budgeting has served the best interest of Georgiat 
and the budget analysts in this survey evidently believe U 
should be continued. Only five budget analysts recommended 
its discontinuance. 

The University System of Georgia 

por fiscal year |973t the institutions of the University 
System of Georgia vvere a^Ked to prepare a preliminary zero- 
based budget for all aUiviUes CAuept primary resident instruc- 
tion, research^ and public service, Scltxted units under resident 
instruction were at fjist included In the requirement but later 
exempted. As aresultf only the Agfioultural Expert nten t Staboiit 
the Cooperative Extension Service^ and the Mannc Resources 
Extension Center now prepare a preliminary budget request 
using zero-based budgehng methods. Although these unn ^ 
prepare preliminary zero-based budgets* they ai^tually prepart. 
operating budgets and maintain all accounts by conventional 
budgetary methods. There is no planning! no preparation, nui 
any other remaining application of the zero bas^ concept in 
any resident instruction unit. There <s good reason to belicvct 
therefore! that zero based budgeting ha^ not been utilized m a 
higher education setting in the !>tate of Ge\>rgi4 (Barber, t97T^ 

Yetf the requirement of zero-based budgeting in th^ pre 
liminaiy budget requests for fiAcal year 1973 created woni^idci 
able ^tivity vvithin the University of Georgia. A flow ^hart of 
the university's budget was prepared, evidently for the fit^i 
time, and vvith much other data gathered, there vvas a resultant 
appreciation of the university's 300-plus budgetary units, vvhich 
had not been possible previously. This appreciation may be the 
most significant outcome of the experience to date, 
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Budget heads on the University of Georgia campus who 
wcfe involved in the process report varying opinions and 
beliefs concerning the efficiency of zero-based budgeting. At 
least one experienced budget head believes the method gave 
him better grounds on which to discuss his functions and 
activities with superiors. To no little extents he thought the 
approach pve him "a manipulative advantage" over his superiors 
rather than the other way around. The continued use of zero- 
based budgeting in preliminary requests for the Agricultural 
Experiment Station and the Cooperative Extension Service is 
not seen as helpfuU however because of the diverse funding 
sources State» federal, and university system requirements 
mu^t be met, each imposing its own burden of paperwork. 

Baste Assumptions and Implications 

If zero-based budgeting gives a sense of deja vu, it is 
because of higher education's experience with PERT, PPBS, 
and MBO The patterns of these ihree managerial techniques 
and zeio-bascd budgetii^ have many similarities. Each technique 
has roots in corporate industry, tiansferred experience in public 
ndmintstration. and then a period of advocacy for institutions 
ofhigher or postsecondaiy education. In each case* the transfer 
of [cchnique, first to government and then to higher education* 
eanie with something bordering on religious fervor 

Even a quick skimming of Peter Pyhrr's book or his 
article in Harvard Business Review will trigger a cynical 
humming of, "Jt seems to me Tve heard that song before/' 
The technique begins wtth "promises, promises" and leads 
quickly to linear arrangements in charted passages through 
operational mazes As in most managerial techniques* there is 
the belief that corporate industry, government, and education 
are isomorphic in thetr demands for* and their amenability to^ 
managerial effectiveness There is an explicit faith that tceh- 
liques developed in one organizational setting can be trans- 
ferred without extensive modifieation to other organizations 
and institutions Pyhrr hedges only slightly in referring to 
philosophy nnd procedures thnt are "almost identical" 

The basic premise of zero-based budgeting is that pro- 
grams, functions, and activities themselves, not annual in- 
crements in agency or unit budgets, should be justified. The 
process makes a distinction between planning and budgeting 
but is not explicit about the nature and details of planning that 
must clearly precede the budgeting process. The development 
of a zero-based budget assumes that work cnn be broken out 
into functional units that cnn be reassembled as a system of 
interlinking parts An implicit interaction of goab, operations, 
nnd organizational capabilities is recognized. 

There are six basic assumptions underlying zero-based 
budgeting that may be identified: ( I) it will permit an analysis 
of purposes* costs, and benefits. (2) attemattve courses of action 
can be specified, (3) the consequences of those altemntivescan 
be identified and nsse^^scd. {4) the process will improve the 
effectiveness of resource utilization, (3) the involvement of 
managerial personnel at operational levels will eventually re- 
duce the budgeting process, and (6) successful application of 
the technique will result In better decision making* as weU as 
suggestions for innovation. 

Such assumptions are not unknown tn PERT, PPBS, and 
M60, nnd there is temptatton to conclude that zero-based 
budgeting is but another rational* management tool that offers 
n systematic way of exantining ongoing programs and activities 
that is normally exercised only for new or expanded programs. 
Such advant^es as zero-based budgeting might have for higher 
education would appear to be the rudeness with which it breaks 
into datty routine and requires a critical look at functions and 
activities long taken for granted Also, a decided advantage 



might accrue from the emphasis zero-based budgeting ostensibly 
places on lower-Ievet decision making in the budgetary process. 
There are always academic department heads who would wel- 
come a more direct input to the budget process and better 
control over budgetary expenditures. 

In Pyhrr's opinion, zero-based budgeting is effective be- 
cause it focuses on the actuaJ dollars required for successful 
operation and not on percent increase or decrease in the agency 
budget as such. How well this would pennit institutions of 
higher education to identify and compare pnonties both within 
and among departments or divisions of instruction remains to 
be seen. Program budgeting did not succeed in this respect* 
and it is well to recall that zero*based budgeting has specifically 
excluded direct production and manufacturing costs from the 
process. Zero-based budgetii^ is applicable, according to Pyhir. 
only to dte administrative, teehnica], or nonproductive portions 
of the corporate budget. For a I nbor^in tensive industry, such as 
highereducation, where the major production units an; academic 
departmentSt the technique could involve some jamng im- 
plications. 

The Product is the Process 

The most audacious assumption of zero-based budgeting, 
however, is its requirement that the goals and objectives of an 
organizational unit should determine its budget — and not dte 
converse. 

Many of us wish this were true in higher education. 
Unfortunately, organizational goals, being nK)re implied than 
explicit, are determined to a greater extent by the funds thnt arc 
available (or by the prospects of additional funding) than by 
clear-cut choices that are made pnor to the availability of funds. 

Hiere is no evidence that zero-based budg^nng results in 
more clearly established goais or that it provides better nteasurcs 
of perfonnance or progress toward the fulfillment of those 
goals. The budgeting process is still dependent upon an ex post 
facto fonn of rationalization than permits or requires the 
budget rrraker to justify expenditures m terms of worthy direc- 
tions and commiunents. White zero-based budgeting may be 
helpful in eliminating costly add-ons or accessones to essential 
programs and a needless duplication of costs in fnnge or 
marginal aetivitics, there is little about the process that would 
suggest that it is a cost-effective technique in its own nght. 
The test might be whether the money it saves is worth the 
money it costs. Staff timet paper, photocopyingt etc. are all 
costs that are added on the usual cycle of budget-making 
whatever that usual cycle might be. A pnxress that eliminates 
expenses for tlie triviaJ or incidental but costs unknown amounts 
in staff time and clerical inaienals is not cost-effective by 
virtue of savings alone. 

Nor is there anything in zero^based budgeting that pie- 
vents trade-offs, compromises, negotiation, treaties, pay-offs, 
and other forms of pohtical behavior on the part of those 
making out the budget. Decision packets will still be identified 
with decision makers, and the logical necessity of certain 
functions or activities will always be more obvious thnn others. 
At the same time, there will always be the uneven adminisua- 
tion of the decisions and judgments that must be made to keep 
the process credible. 

Tn conclusion, there may be little about zerO'based budget- 
ing that is novel or unique. And there may be htde about it that 
promises any special advantages or benefits for institutions ot 
higher education. Its only advantage may be the process it 
requires, and the benefits may be too subtle for widespread 
adoption in higher education. There is at this time good reason 
to believe thnt the virtue or ment of zero-based budgeting lies in 
process only. No one should expect miracles fronithe product. 
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UNIVERSrriES: CAN THE DATA BE COMPARED?* 
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Institutional researchcrSi at leasti know that questions 
such What is the enrollment your college orunivcrsity?oi 
How many faculty members arc there at your college or 
university'^ must be answered with care, panicularly if indices 
may be calculated and comparisons among institutions may be 
made from ihc d?ta Too many strange sluden^f^culty ratios 
ha^'" seemed to resui[ from the absence of detailed and observed 
^liinitioas and misi' ^erstanding of the data for the lesson 
with regard tc stu(. and faculty counts not to have been 
learned. 

The principal purpose of this paper is lo demonstrate, 
using infomrtation on luition fees, other required charges, and 
non-required fcs at 20 major public universities', that the 
question What is the tuition ai your college or university? is at 
least as troublesome as the questions about numbers of students 
and faculty A. secondary purpose is to describe a numtb^ of 
characteristics of the student charge systems in use (1970-76) 
at the subject universities It is ihe variation in these eharacier- 
i.siie^k which leads tO difficulties in defining student charge 
limns and in wording student charge questions in maniters that 
result in data that are meaningful, to say nothing of comparable. 

Method 

Data wCtC collected by means of a three-page survey 
mstniment The first page contained survey instmctions. Form 
A was used to report required student charges. Multiple versions 
of Form A were completed to reflect differential charges by 
program and student level and for regular semesters or quarter> 
and summer sessions The dollar and cents amount of each 
separately named required charge for each value of number of 
credits enrolled for resident and for non-resident .students was 
emered on Form A along with brief names and descriptions of 
the separately named required charges. This paper ^dresses 
only the data for regular senftesters and quarters. None or ihe 
data on summer session student charges arc included. The 
number of Form A's completed for individual universities 
ranged from 4 to 18. 

Form B was used to provide information on non-required 
student fees It was simp'y a checklist of genedcally named 
nt^n-required charges with spa^ *s to indicate amounts and lo 
enter remarLs Oivc Form B was completed for each university. 

The Form A on required charges per credit enrolled were 
graphed in order to reveaJ the shapes of required charge func- 
trolls Many charge 'eristics of rcqui* / charges were also dis- 
played by "^'^versity in a summary chartt available from either 
of the authois upon request A non-rc<]uired fees chart sum- 
manzmg the information provided on Form B's wa^; aho 
prepared 



Findings 

The predominant feature of all ihe information collected, 
graphed, and charted h diversity. No matter what char^ensttc 
of student charges stated by the 20 universities is consider^, 
there is variation among the universities m the manner in 
which it is stated. The following summaries of specific char- 
acteristics of student charge ^kystems ^substantiate this general 
finding. 

Tertnjnolo^t Most of the sample universities assess a 
bastc^ compretiensivct multipuipose* undesignated^as- to-specific- 
purpose charge. This is here labeled the ''general charge,'* to 
distinguish it from "special charges'' which are assessed all 
students, normally in addition to the general charge, and are 
designated for specific purposes. Only nineof the 20 universities 
refer to the general ( arge as tuition. Stx of the remaining 
u.iiversities reserve t.i^ term tuition for an additional charge 
assessed non-resident students. Five of the 20 universities 
evidently make no use of the term tuition in stating student 
charges. 

Many Of us think we know what is meant by the o 
tuition^ but what would we expect to learn if we colleacd data 
from these 20 universities on the amonnt of tuition assessed a 
full-time student for a semester or the equivatent thereof? 

Other terms used for the general charge* and the number 
of the 20 universities nsing each* are: incidental fee (2), 
instructional fee (2), instiuciion fee (ih course fee (I), registra- 
tion fees (l>, gener::i service fee <l), comprehensive fee (I)* 
operating fees ( I u and full program fee— combined with enroll- 
ment fee for re^'uced program and reduced ptxtgram charge per 
hour ( I ). Terms used for special charges also vary widely. The 
term incident^il fee U used a', one University for a special 
charge an.i by two others, as noted* for the general charge* 

Knowledgeable persons who collect data on faculty have 
lea" * It the term faculty, because it means different things 
ai 1 p. places, should be avoided in describing the persons 
L ■ udcd at>d in defining thf, data items sought. The 
;rc is that the term tuition should be avoided in 
cofk ./iig dati on studen: charges. It may be necessary to 
admonish the |>erson at one college or university who is 
seekin|. student charge uata from another college or university 
not to ase local descriptors on the p.iesumption they have the 
same, or any> meaning elsewhi^rc. 

General and ^kedai charges. Charges applicable to pnn* 
eipa) Ctitegories of undergraduate resident students were elas^i^ 
fied as [^cneral or special charges, as previously defined. 
Although the survey instrument did net iriclude spectfications 
for distinguishing between general and special eharge.s, thi$ 
distinction >%as obvious in most uses. However* the categoriza- 



^^uihi>r't Wi>ie After ihis paper was presented at ihe t977 Fonim i>f Ihe Associriion for InsliEUhonal Rojcarch. we discovered haJ misinterpreted 
dara pnwfded for PtnnSylv^nM Slate University (PSU) Spccincally ( t) at J* students enroll for. and are a^ssed tuition on the t>asis of semester 
^T^dits kir courses offered on a i|Uaftcr calendar, and we should have used a normal load vatue of 10 eredits* rather than t5. in our calculations: and 
i2iUK pe- ctedil charge for cr»Jits in excess of }3 which led u»lo describe ihe PSU charge function as mtd^range plateau was. in fact* a prqx>sal that 
WIN not ^opted We have mit revised the paper In i-orrect 4k PSU data fmt offer this note as additional evident thai it iS difficult 10 as^inbfe 
ci>tnparable data on student eharges 
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lion of ihe julhor^ [na> not be v.ompIctcI> avv^urdtc Two 
untvcfsitic^ a^&& no general cha^ge^t mo^l have a Mngle 
general charge* two ^tate two general cha^ge^ (tujU^n/v.onipre 
hen&ive fee and tuilion/opc ruling fee^)» and one d^^lJngUi^he^ 
among a full program fee* red uc<^d program fee, anJareduv^ed 
program charge per hour. 

The number of separalel> staled special ch^ges ranges 
from none to four or more. The "or more** equivocation 
results from the fact that a student activity fee* for example* 
may in fact include a variety of components which consist of 
amounts designated for different student activity puiposes and 
income account^. Even the present comprehensive and detailed 
Collection of ^tudent charge data does itot reveal all detaih of 
this type. The names of array of spcv^ial ehargcs and the 
designated purposes* in some case^ inferred from the names* 
vaiy considerably among the 20 universities. 

Amounts of the general and special required charges for 
resident undergraduate students for the 20 uni 'ersities may be 
summarized as shown in Table I- The dollar amounts stated 
are eharges for an academic year (1975-76) of either two 
semesters or three quarters for a student enrolled for 15 credits 
per semester or quaner. 

Table ] 

General and Special Required Charges 
for ReMdent Undergraduate Students 
in 20 Universities 





General 


special 


Total 




eharges 


eharges 


required 


High 


$I,J65 


S638 


SI ,365 




0 


0 


370 


Median 




117 


672 


Mean 


577 


t5a 


731 



The lesson learned here i& that* with respect to the burden 
on the ^tudent and the comparabdit> of data, the di^tJnctJon 
between f.:'\e:^l and bpecial charges ^hould be ignored* on]> 
the [otalc/, .^le two t>pe^ i^ meaningful. Of cour^^* thedJ^tmL 
tion h inipodant to mdisidual v.o]legc& and universities bc^^au^c 
of the var>ing manners in whKh the ratc^ are e^tabh^hed and 
v^harged and the differing dispositions of the income Bu e 
person at the university whidi collects an jncidental fee (general 
charge) and a ^tutknt activity fee (sSpev^ial charge) should not 
expect to Collect data comparable to the two local charges from 
other universities. 

Non resident chargeSr At public unt\ersitjcs. the amt^unLs 
of required v^harges for non resident undergradiate students 
txcecd the amounts for resident stude^ is This js well known. 
However* i: ma> not be well known that this result is aditcved 
in two ways Six of the 20 universities assess ijon-residcnt 
students tuition m additjon to the general ai.^ pcv^ij rei^uin^d 
charges asses^scd resident students. This can t^e v^allcd ihcaJti 
on procedure. The remaining 14 universities^ simply state 
higher rates for the genrral charge(s) for non resident students. 
This can be called the rafe procedure. 

The person who is f^mihar with only one procedure - the 
add oti or the rate -may assume that there is only one ^^ay tu 
assess m>n residents more than rcsjdcnts and may cnv^ijumcr 
problems jn acquinng v^oniparable data from colleges or uni 
versitics which use the other procedure The lesson learned 
here is that the question should be What is the total required 
charge for n^n resident ^tudcnts? and not What is the special 



extra required charge for non-residcnt students? or What is the 
amount of the general charge for non resident ^tudents? 

Total undergraduate rton-resjdent charges and the amounts 
and peuentages by whkh these exceed the comparable resident 
required v^harges for the 20 universities can be summarized as 
shown below. The dollar amounts are charges for an ^ademic 
year of either two semesters or three quarters for a student 
enrolled for 15 credits per semester or quaner. 

Table 2 

TomI Undergraduate Non-Resiilent Charges 
and Inv^remet.t over Resilient Ctiarges at 20 Universities 





Non-Resident 


Non 'Resident 


Pcrccrtag4> 




Charge 


Incienicnt 


Increment 


High 


S1871 


St,90S 


297 


Low 


1366 


790 


98 


Median 


L764 


t,09O 


t44 


Mean 


t.897 


1,172 





Of interest here is simply the variability and the high positive 
skewjtcssofthe distributions. The high values of these measures 
are from two to three times the magnitudes of the low values. 
At one of the 20 universities non-rest'lent undergraduates pay 
twice as much as residents: at another* they pay four times as 
mueh. The modes of the three distributions are very close to 
the low ends of the distributions. The most popular $200 
ranges for the non-resident eharge and non'residem increment 
figures ape Sh500 to Sh700 <8 universities) and $800 to 
SlfOOO <7 universities)* respectively, fhe most popular 20- 
pereeni point range for the percentage merements is \20% to 
140% <6 unLversLties)^ Data comparers should understand thai 
comparisons with means* medians* and modes from skewed 
distributions of peer instituion measures yield different con- 
clusions. 

Different ialEoR by level and program* None of the 20 
unive cities employ the same required Jiarge s\.hedule for all 
resident or non-resident ^tudcnts. Thus* the question What is 
the total required charge for full-time resident students/ has no 
unequivocal answer no matter how thoroughly the lerinsof the 
question arc defined. The types of students subjtv^t to liiffercni 
required charge schedules can be itienttfied by the level of the 
siudent (lowQT division* upper division* fir^t professional, or 
graduate) and degree program. Typically^ both identifiers are 
required. 

U^fing the required charges for typic^il or lower divisiot* 
undergraduate residents or non-residents as d base* differentia^ 
tion occurs for a variety of levels .md programs. One of the 20 
universities has differential charges for typical upper division 
students. Four have differential s\.hedules for individual* or 
groups of, undergraduate prK)grams. Two of these four have 
different ^.hedules for one program ea^h* and two have three 
schedules for different undergraduate or upp^r division pro 
grams tn addition to ihc ba.^c one. 

All fir^t professional dentistry and mc\Jical programs of 
the 20 universities have charges which are higher than those 
for undergraduates. Five of the six umvcrsities offering vet- 
erinary meJkine and 14 of ihe 18 ivithljw have differentiated 
{higher) required v^harges for the first prK>fessional students of 
these programs. Th^, degree of differentiation for resident 
students in Hrst prK>fessfondl programs vanes from ^.haigcs 
whiv.h are B% (a jjw progiaiiU to lll'^ 4a mcOiLal programJ 
higher than the basK untkrgraduatc required v^harge, 
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Thirteen of the 20 untvcrstties have dirTcrentiated rcquired 
ch^irgcs for all graduate students, four have one differentiated 
schedule for selected graduate programs, and one ha^ two 
differentiated schedules for t^leeted graduate prognims. Only 
five of the 20 universities charge all graduate students at *he 
same rates as undergraduate students. 

In only two instances arc the differentiated charges for resi- 
dl'nt graduate students less than the basic undergraduate rates. 
At one university, the graduate student rate ^ : 9H% of the t>asic 
undergraduate rate At another university* nursing students at 
afl lavcfs are charged just over half as much as all other 
students. 

Not only is there variation in the numhcr of differential 
required charge ^hedules and the types of students to which 
they apply, therr is also variation in th^ 'nanners by which 
dif^t'ivntiation is achieved As with the ach '^vement of dif- 
ferenttation for non-n^sidcnt and resident students* there is an 
add-on and a rate method Of 59 sets of differentiated required 
charges Identified for the 20 universities, eight involve an 
add on charge* 51 involve different rales for the general and/or 
special basic required charges, and seven involve acomlbit^- 
tion of the two In only one instance* a upplementary fee for 
first professional medicine and veterinary medicine students^ u 
differentiation achieved solely by an add-oA charge. Or* *h»f basis 
ofthcir names (instructional materials fees, law fee, testing fee* 
computer fee. publication fee, and microscope fee)* the re- 
inainrng instances of add-on charges appear to be add-on 
special charges designated for specific purposes. 

Even ignoring the information assembled but not discussed 
here, on non-resident versus resident required charges in the 
instances of differentiation from basic undergraduate required 
charges, it is evident that differentiation by level and program 
*s a varied and complicated rtiatter The lesson learned again 
is that comparable data cannot be obtained from simple ques- 
tionsorwidioutsonMr understanding ofthc complexities involved. 

Required charge functions. A required charge function 
describes the relationship between the number of credits for 
which a student enrolls and the amount of the required charge 
assessed Functions for undergraduate resident* undergraduate 
non-resident. differential resident, and differential non-resident 
chargcs^and foi components of each may be examined Seven 
types of functions for required undergraduate resident student 
charges are in use at the 20 universities They are described* in 
order of frequeney of use,, a> follows: 

With the per- -edit -lo-phieau function, charges are as- 
sessed at $r pa credit for 1 to w I credits and at (Sr x n) for n 
and over credits The plateau begins at tt credits Eight uni- 
versities use thts type of function for determining undergraduate 
resident charges For five of them, n = I2«fortheotherthree. 
the values of n ore 7, 9* and 10. 

The per -credit -step-to-phteau function assesses charges 
at $r per credit for I to rt- 1 credits and at (<$r x + $j] for n 
and over credits The value of ^ > r) is the size of the ^tep, 
and the plateau begins at n credits Four of the 20 universities 
assess undergraduate resident charges by thi.s type of function 
The steps occur between ^ and 7, 7 and 8« ^ and 9* and 1 1 and 
1 2 credits The plateaus, of ck. '^c, begin at the upper ends of 
these pairs of values 

The per-iTedit function is just that, charges are assessed 
at %r per credit for any number of credits Three of the 20 
universities use the per credit function for undergraduate resi- 
dent students 

Bi-levei functions assess charges at $it for 1 ion- \ credits 
;ind at {%k + Ss) for n and over credits The magnitude of the 
step between tt-\ and n credits is Sj Two universities use bi- 
level functions for under]graduate resident charges The ssteps 
(Kcur between 8 and 9 credits m eaeli case 



The iri'ievel function* which includes two s^eps :)nd direc 
plateaus* ts used at one of the 20 universfttes for assessmg 
undergraduate resident charges. T>ie plaieau^ are for I to 5. 6 
to I Land 12 and over credits. 

The mtd'range plateau function assesses charges at $r per 
credit for 1 ton-1 credits* at ($r x for n torn credits, and Zr 
per credit minus l%rx(m-n]] for mote th?n m credits. The 
plateau begms at n credits, and end^ at m credus For the single 
university at which this function i^ used for undergraduate 
resident students, the plateau extends from 8 ;o 13 credits 

Fin^iilfy* one university uses the flaUtaie function by 
which charges are assessed at Sit for any number of ciedils 

An amazing variety of versions and coir^binatiott^ of these 
seven types of required charge funettons is used hy ;he 20 
universities for various types of the differentiated charge cascs- 
In three cases, the form of the function used tor undergraduate 
non-residents is not the same as the one used for residents. 
Fourteen of the 20 universities use two or more of the seven 
function types for determinmg required charges for different 
types of students. Even where tlN^ ^ame type of function is 
used, ujc parameters differ in sotnc cases, for example* where 
per -credit 'to- plateau function ls u^. the plateaus ai^ likely to 
begin at different points. 

The principal diff:eultii:s highlighted by the existence of 
this variety of specific required charge furH:tions have to do 
with comparing amounts charged part<t:me and fulMitne stu- 
dents. While, to date, no survey may have asiicd What is the 
required charge for pan-time students?, nothing is r ^ssible. 
The growing proporlionsof pan-time students at many or most 
colleges and universities* combined with tlu: fact that systems 
remain m use for assessmg student charges established for 
predominantly full-tmie stvd'.nt bodies are creating questions 
about how to determine appropriate charges for part-time stu- 
dents. It Ls not unusual for a question on policy to generate a 
sui vey. The lesson is ihat thee;iistence of a variety of required 
charge functions would need tobenxogni^dmany atietnpt to 
assemble comparative data on charges for part-time students. 

Surveys of required charges for fulMime students arc 
common, and the existence of the variety of required charge 
functions creates problems with such surveys. The college or 
university usmg the pcr-crcdit-to-plateau or pcr-credit-step-to- 
plateau function has little difficulty in stating charges for full- 
time students. However, the pcr-eredit institution may. 

One strategy used by data collectors is to leave full time 
undefined on the basis that better data resuhsfrom the applica- 
tion of the local definition of what constitutes full time. Problems 
with this strategy are that the idea of normal load (for example* 
15 credits) is easily confuM^d with the idea of full time, defined 
as at least IS percent of normal load, and that full time denotes 
a range (for example* 12 or more etedits) and is. therefore* 
ambiguous, A second strategy is to define full time very 
specifically, for example* a student enrolled for 12 or for \3 
credits. The problem here is that the spcctfic definitton may 
not be appropriate at all colleges and universities. 

A compromise strategy may be to define normal load in 
general terms and then to ask for arrounts charged normat-load 
students. Student levc. lould bc taken mto account, Typtcally* 
the nonnal-toad values for undergraduates* for first professional 
students, and for graduate students do differ* and these dif- 
ferences may need to be considered. Also, differcnees among 
the specific Hrsi professional programs may need to be considered. 

An example of how not to do it is provided by the present 
survey of the 20 universities. Data on normal load were not 
collected. In tabulating amounts charged for various types of 
.students* charges for 15 credits were used This may be a 
representative normal-load value for undergraduates* hut it is 
almost certainly inappropnate for fintt professional and gradu- 
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at^ \tudcnts. Bctau^c the purpose of the ^^rvc) w< » tu ex Jm^:^ 
cump^b)t:t> problcjfis and not to de\'cl<)p t^omparuble ddta. 
this Jtmttaiion to the sutnmsfy data, mont of whidi is net 
presented herc, is not con<i(dercd serious. 

Non-jrequjred charges. College^ ana universities clwr^c 
indivtdiiQl students fct a wide vanet> of individual services or 
tf4jj>action& The information on ^u^^h *xd hoc changes for the 
20 Linivcrsities i& voluminous but c^nr.oi be ton^kitlercd dcflni 
tive beeausc of the great variety of designation^ u><:d for (he 
cha^i^es, spc^^lfic ^ircumMances in ^fth^h thc> are applied.* and 
rate^ appJkabIc fur if.iivtdual charges under ditTtring i^irtjm- 
slisnces. Because of th** variety of pra«.ticesi tt appears to be 
Virtually impossible to Assemble comparable jnJ mcanmgful 
infcrmation oii non reqiircd charges. 

The n'jfTtber of novrcquircd thar^es at ejich of the 20 
universities rianges from just over iO to nearly 25. They can be 
eare^crizcd as (I) admission fees, (2) rcgistratm fees^ (3) 
graduation feesi, including (hesis and dissertation, (4; facjhty 
or et^uipment use fees. [5) special course fee^, 6) griduate 
research and continuous-enrollment fees* (7) voUtntar> jtudent 
activity fees* and (8) a variety of other types of fees. Amounts 
range from 25^ for an unofHeial transcript and SLOO for an 
add/drop transaction to SZ^Ofc^ran applied musi*. t^ourse in^>n- 
majors only) and $325 for a field-tnp cout^ 

The lessons learned from thi^f sof^ information are that, at 
best, comparable data on no n -required charges are difficult to 
assemble and that recjuired charge^ account for a variable 
pcrtentage of the total income colleges and universities obtain 
from students. Surveys ^hich seek tittottnation on rcqujied 
bhaiges leave hidden the Tian^^ral buiden on students of ihe 
non-rctjuired charge^^ and given the present st^tc of ihe ait, 
this burden might as well be left hidden in the surveys, 

Recom m enilattons 

The follov^ing points are offered for 4^ort>ideration by (he 
person seekitig to collect comparabk dfita on jti^dcnt charges 
from any group of colleges and universities. 

I. Der;ne tcmts carefully and avoid the term /u^/^c'N It 
might even be desirable (o avoid the term fees* b«:cause it 
meuns different things at different colleges and untversitfes. 



2. Stzvk informd,ion on t ital rcqu.ied ^^hai^es and insure 
that survey mstnx^^tions spc4^:f/ ihat special retjuirtd ^^kaig^s 
are incUideil. 

3. In t^H^ ease of nublie colleges and univetsities, u<ik for 
ioidl amour'* t leot J i^^arge^ ^:>&vsed nori-^e^ldt;nI jiucenis 
as compared ^v(th resident students. 

4. $pv** ^f> the categurv or categories sttideats for 
whivti ret{niruj i-harge ^moanis ^re desired. Of iiiusi jnicrcsi 
usually .vill be the rates ih<tt apply lu (he gre<.^st numbers of 
^undergraduate students I*.4ta4ices of Iv^vu division versus 
upper division different i,iti^n need be recognised. Separate 
infuiniation on aP|ilicablc to giaJuute Mudents and to 
.ttudtfits in jpec4ried first pmfessional -vj^iain^ may be of 
inte^:^st Beyond these baste categories, vartacions in tne prae^ 
tiLC of J.ft'erentiation b> prograai and tjvel can be addressed, 
if one really c&rcs. 

5. If required charge ^r,^unts for U 11-Cime students are 
desired, recogni/C that full time spar, a .ange of number of 
^rcdiis enrolled and define what mcjm ijy .lomial load. Then 
.isk fot rates applKa^le to n*^riTiaJ-load ^^den^s. Consider 
distinguish lug between i^^mnal toad f^r i^ndcrgioouatc, gradu- 
ate, and fir^t professional progran. ^Udents. Seek infonnatton 
on required charges foi t-art time Mudcntb v^ith great 4^jie and 
on the ba:iis of an understanding of the vanety of required 
charge functions that Is tn us^2. 

6 Rccogiiizc that studenb piay nun-rc^uired as weW as 
reqiiiivJ charges, but do not attempt to bollet^t comparable data 
on non-ie^uired chaige^^ unle» a specific purpose reqi^ires ti 
and.* then* only wtth tonstd&rable planning and vare. Po noi 
divide r4nanbial repu^lamounC^of iiKome from tuition and fees 
by any counts of nuniber of students and expect to be able to 
interpret the n^sulttng averages. 

The ijuestion raised by tlie title of this paper is Can 
student charge information eolleeted from several colleges and 
universities be compared? The ansv^er seems t^ be that if 
suffit^ient understanding, ihoughi, and t^ntc are devoted to 
planning, data collection^ and analysis, reasonable degtees of 
comparabiJity of major types of student charge data .an be 
obtcmcd. 



Footnote 

^Thc ^ unikcr%iiic\ jtc Umvcr%,iy A CjI fufnu Berkeley « tifiivcrffi/ of CjlifLOi^-Lo^ Angeles, LinL,crMi^ of iHrrK>i\-VJitMn3. OmvcnU> of Iowa. Iowa State 
rfiis^Kiij. I'n^i^fMi^ of Kdn^%. Mi^hi^Jn Suu. Ldivcrviij. tjnivcrmi; of Mhht^jn. Lnivcr^it^ of MmnCvjU. Lnivcmty of Mi^^uun-Ci>JURitiiti. University of 
Nthr^ikj 1 ir^iJi*. <;hi,pSutc Um^cr^tij L-.i^^rtMi^ ofOrtiion. Penn\>^jniii Suit tnivcnH>. Um^CrMfy Pu(\Njfgh. Piitjuc tJjuv<JM(y. VJnivcnily of Tc^ai-rtuMjn. 
Uni^cr\il/ ot ^ ifiimij. C>iiivUm^> <^ \^.ivhm^ioit. Uni^crsiiy of ^tsi-oiiMti-MiHtiHHi In a ftv, \jsc u for xp/rMc itKaical M,h<x)l \ampu^c\ ^rt iikIu*^ 
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Institutions of higher education have entered a period of 
fiscaJ Mrjngeney. Private institutions^ with heavy reliance on 
tuition* are particularly vulnerable. Yet, in spite of these 
financial concerns, there is only limite<l knowledge eonceming 
the measurenietit of financial weJI-being. Ceriainlyi there is 
no consensus with regard to the noethods of measurement, 
A4ar;y researchers rely heavify upoti the Higher Education 
General Information Survey (HEGIS) data. The obvious ad- 
vantage is that these data aie collected in a uniform manner, 
presumably, from every institution in the country. However 
as many campus offieiafs will admit candidly, the responsibility 
for the HBGIS reports is of^en delegated to nonprofessional 
office workers. Moreover, while the data that ae collected are 
important, olher useful data ate not aeeutnulated in that federal 
survey, Cenainly* the fact that HBGIS finaneiai information 
concentrates on current fund data is a serious limitation. Mur- 
dockand Davb( 1 975) advocate the use of institutional financial 
statements for outside evaluation ofcolleges and universities. 
Their argument becomes even more forceful with the incix^ing 
acceptance of the audit guide for colleges and universities pub- 
lished by the American Institute of Certified Public Accountants 
(AICPA) {1911) which sets standanl guidelines for the torm 
and substance of the auditor's product. The analysis reported 
in this paper makes extensive use of the college annual financial 
reports and supplements that information with data on students 
and faculty. 

Turning from the 

source data to the analytic forHiat^ 
this researcher takes the position that h is unproductive to look 
for one '""bottom line'''' measure. Understanding the complex 
nature of colleges and universittes, this may seem to be self- 
cvrdent. Yet, many researchers continue to seek this final, but 
clusivCi measure. Bowen and Minter recognize the problcmi 
yet they inexplicably assign "'arbitrary weights . , , to convert 
the data into a single index of "strength' " (1976, p, 89), 
Lupton, Augenbtickt and Heybon (1^76) were more explicit 
and evoked a storm of protest. (See Finnt 1976; Johnstone, 
1 977.) The point is that it is probably impossible to create one 
faultless measure of institutional well-being, 'I'his report uses 
five dimensions of institutional health: demand for the producti 
liquidity, debt structure^ resources, and operational analysi^k,^ 
For each dirrtcnsiont a number of specific indicators ai^ used 
without preassigning a value to any one of them. 

An additional criticism of college and university financial 
analyses is that they attempt to evaluate a set of institutior^ 
^hich is too broad and diverse. The analytic framework de- 
scribed here was applied to sitnilar types of private colleges. It 
is not appropriate for public institutions* nor even very larige 
private ones. The methodology could, however* be modified 
to suit these types of institutions. 

Purpose 

One purpose of this teport is to deseribe a relatively 
straightforward system for cvaluatir^ college ami university 
ftnancial health. The wocd relatively should be emphasised 
because the task \u by \i$ nature, not a simple one. There is no 
substitute for informed Judgnienis, However* a consistent frame- 



work can assist in the initial peECcption of problems and in 
framing questions for further study, 

A second purpose of the report is to provide n;fereiH:e 
data for comparison. Again* these data can be very useful in 
identifying possible problems and for suggesting areas which 
need further study. White the study apon which the repon ts 
based examined the financial trends of seven subgroups^ as 
well as the trend of the full sample, only the trend of the 
cotiiplete j^ample will be reviewed in this report. One reason is 
that the data for the subgroups are far more similar than thtsy 
are disparate, A second reason is that some of the subgroups 
arc rather small. Therefore* greater reliance can be placed o^ 
the trends revealed from the study of all 40 colleges included. 

Sample Institutions 

Pony colleges participated in the study. Each had cither a 
single-sex admissions policy or was religiously oncntcd in the 
1960s, Some of the colleges became coeducational Some 
became more secular. And* some changed very lilllc m these 
regards. All had taken -he College and University Environ^ 
mental Scales (CUES),* Because of these limitations, the sample 
cannot be considered* ttecessarily* as represenlativc of all 
small private colleges. However* because most small private 
colleges had reUgious ties in the 1960s and many were single- 
sex, this limitation is not as restrictive as it may first seem. 
Moreover, it was already pointed out that the data for the 
subgroups showed many more commonalities than differences. 
This general uniformity further supports the contention that 
these data provide a reasonable estimate for the financial 
trends of most small private colleges* particularly nonselective 
ones. With the exception that there are no colleges from the far 
west, the sample represents well the geographic distribution of 
ail small private institutions in the country^ 

Methodology 

Consolidated balance sheet.* College and university 
financial reporting practices have historically focused on the 
control and use of funds accrued from separate sources. From 
this principal of stewardship has evolved college and university 
fund accounting — separately aggregating and reportirig financial 
information. While one may be reluctant to quarrel with the 
need to maintain separate records for certain funds* it is difficult 
to reconcile the extremes to which this prificiple is earned* that 
is, the absence of a final aggregation in the financial reports. 
Such an aggregation is necessary if one is to make any sense of 
trends in debts, assets* and equities. Indeed, nnany crttiCK have 
advocated the use of consolidj^tcd balance sheets, (See Jenny, 
1973, Bastablc, l^3iPricc Watcrhouse and Company, 1^5; 
and Wilkinson* 1976.) 

This study created consolidated balance sheets for caeh 
it^titutiOD, atHl an average balance sheet for all institutions, in 
the following manner: 

1 , The agency fund was excluded from the analysis, 

2. Assets wece subdivided into three categories: (l)liquid 
assets, <2) othe: assets, and (3) fixed assets. Liquid assets were 
con^kidered to be all a^^scts which could be readily converted 
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into ctish to meet current obhgtitjons. TKesc dsi^cin in^lutk 
ctiah, ^tui,ksr bunO^, tifkl interest nxcivablc. Cash ui the loan 
fund ^^a^ not con^i^crctl It^uiJ bcvdu^ thi^ JTtufK^ tjpicalJj 
federal monc> or niunc> matchmg federal funds. Fixed a^^cb 
iiKladcd all buildingi lanO, equipment, and construction in 
prvgrc^s. The remainmg a^^ts v^ere placed in the ''other" 
Cfttcgoi>. accounts receivable, mventorie.^, student loan fund 
as^et^t and real estate holdings. 

3. Liabilities v^ere gruupcd in a fashion Simildr loa^^ts. 
1 1) liquid assets, term debt, {1} other debt) and (3) long-term 
dcbr All obligations of college rcquinn^i cash pa>ments v»ithin 
one >ear including interest payables^ deemed v^agc^, withheld 
laxe^, and due pnncipal pa>nients were put in the ^hort-ierm 
d(;bt grouping. Long-term debts are thoy: habilities of the 
colleges that are pd>able after oi>c >ed: le.g.t mortgages and 
bunJsK Debts not ^.onsidcred short- oi long-term v^cre grouped 
m the other" category and inelude. deferred revenues, debts 
to religious order* which operate the institution, and the federal 
portion of the NDSL loan funds. 

4. Total equit> is defined a^ the total of all fund balances 
except agenc> fund, Sepaniic fund balances were also reviewed. 

5. Dealing with the loan Ir'und pcesemed a particular prob- 
lem. Generally, about eight-ninths of the loan fund is federal 
iiionc>. It wa^ decided to include loan fund assets and count 
ihe 'jderal portion oi ihc fund^i as an ' other" liabtlit>. 

6. Inter fund borrowings vtw cliininated except m they 
involved the agency fund. 

Coniivniing unrestrided and restricted funds, Ai many 
inMitutions, particularly research itniversaLe^t combining re- 
stricted and unrestrtcled dollars would be likely to >ield a 
meamngle^s aggiegaiion. However, f-Jf the^c ^mall colleges, 
the simplicity gained by combining the two categories seemed 
well worth the slight distortion, fiihi* based upon twenty-one 
colleges for which dara were availablet restrti^ted income 
represr-^ted less than ten percent of the total current fund 
inu^me m 1975, Second, the restricted inconie at these colleges 
typically wa^ closely related to their edui,ational mission ie^g-, 
^tucknt aid). If these re^trieled funds were unavailable, it is 
likely that the> would need to be replaced v^ith unrestricted 
money. 

Price QcUustmentB. To adjust the data so that Ihey are 
cumparable fram one ye^r to !he next, the Higher Bdu<.ation 
Pnuc Indexes (HBPl) we. - used. Puce adju^ments were applied 
only to operating income and expense data. K)raniore thorough 
di&«ossion of price indues, sec Halstead, 1975, and/or Lanier 
and Andersen, 1975. 

Per student ^justntents. Another adjustment to establish 
comparabilic> is to divide by units of output — in this case, the 
number of f\]il-tlme-cqui^alcnt students. This adjustment Lan 
be nidde for both income and expense reports as well f^r the 
balance sheets. 

Specifle measures* This stud> partitioned the financial/ 
operating analyi^is into five areas. U> demand, iZ) liquidity, 
O) debt structure, 14> financial resources, and iS) operating 
results. In each area several measures were used. They ate 
summarized below. 

1. Demand. Demand for places iS obviousl> of critical 
concern for these tiiition-depcndent institutions. A number of 
tnCa.surcs were used and the interrelationships between the 
measures were considered^^nroUment, applieations, percent 
accepted* percent of accepted siudents enrolling, percent of 
students receiving financial aid, average SAT ^^ores, percent 
of commoting students, percent from out of state, and the 
percent of the student body over the age of 25. 

2. Liqutihty. These measures arc intended lo probe the 
solvency of an institution, that is, how vulnerable the iniJitution 
is to the demand!^ of creditors. Specifically, the measure!^ 



compare resources ^^ith debts. Fund data are clustered because 
an mstitutiun is unlikely to allow bankruptcy if it has sufficiently 
largi: a^ailablc resources in any of its funds. These funis need 
to be expendable!^ but even if they are restricted the money 
<.an be borrowed or used as collateral. The most direct mea- 
sure is the ratio of liquid assets to short-term debt For 
the purposes of this report, this ratio shall be called ihe liquid 
ratio. A second measure of liquidity is the adjusted liquid 
ratio. It is identical to the liquid ratio except that endowment 
funds are excluded. Thus, it assesses the ability of the college 
to meet cash flow without tapping endowment An additional 
reason for including this measure is that the liquid ratio relies 
on the rather erratic book ^alue of endowmer.t. Inclusion of 
endowment book ^alue may be particularly misleading with 
respect to trend data. The final measure b short term debt as 
percent of current fund income. This statistic scales short-term 
borrowing against dollar volume of operation. 

3. Debt sttuKtwte. These statistics are intended to array 
the financing structure of the college. Are the colleges relying 
more upon debt? The most direct measure is the ratio of debt to 
equity. A ^cond measure is total debt as a percent of current 
fund iruome. Again, this statistic scales debt against the ^oI^nK 
of operation. The final measure selected is debt service (prin 
cipal and interest payments) aj> a percent of current fund 
income. Termed <}ebt burdent th,s statistic estimates ihe r^U' -^e 
drain of debt p^aymenh on the current fund. 

4. Resources: The intent of these eriteria is to probe 
trends in the financial ability of the institution to deliver 
education. Truly* these measures are rudimentary proxies 
Yett all things being equal, a weahhy institution is more likely 
to succeed in its mission than a poor one. The primary measure 
of resources is total equity or net worth (defined as the sum of 
all fund balances except the agency fund) This measure is 
further adjusted for (Jepreeiatjon. An additional measure> equity 
per students corrects for the number of students o^er which the 
equity must be spread. Equity per student with investment in 
landt buildingst and equipment excluded and endowment equity 
per student were also examined. 

5. Opetatlng tesuUs. Relying hea^ily on the current fund 
income and expense statementSt these statistics detail revenue 
and expenditure patterns and associated statistics for the ten 
year period. They ^rc not individually reviewed here ^i^causc 
they are commonly found in financial analyses of colleges and 
universities. 

CoUedlng finaneial data. Each college was requested to 
submit four audited fmancial statements: 1964*65. 1967-6S, 
I97l-72t and 1974-75. In addition, complete data on faculty 
and students for these same years were assembled To validate 
the collected data> the estimates, and the measures developed, 
each college was visited and the chief business officers were 
interviewed. After reviewing the work sheets and findings 
with these oflficerst it became clear that the degree of error in 
the work sheets was not unduly troublesome. W th mincH* 
exi'vt^iionst the indicators of this study seemed to highlight 
well the ten year fiscal trends Occasionally, new information 
would surface (e.g., an undetected aeeounting change) and the 
data v^cre altered accordingly But in most instance!^, the 
business off^ers felt the me^ures were a<.curate and revealing 

Results 

Demand. Because tuition represents two thirds of the 
total revenue these institutiunst enrollment is obsiously a 
cntical concem. In this regard, there is reason for both optimism 
and concern. Enrollment increased from an average of 920 
students in 1965 to IJ 14 students in 1972. Since 1972, the 
number of students has been stable. Thus, it appears that these 
colleges ha^e been able to hold their own Another cau*ye for 
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cautious opliinism is ihe fjcl thai ihc pcrccni of accepted 
students choosing to enroll has rcpiaineJ rclatLVLl> stable 
(aixiut 66 percent) And. according lo Ihc returned question- 
naires, these colle|;es have nol become unduly reliant on 
eonimuter sludcnts. t\\o-lhird5 of their studenl;* board at the 
instilulton In addition, the percenlage of sluJent!> coming 
from oul-of-slate has declined only >lightly (from 37 lo 34 
percent) These colleges have, however, become more de- 
pcndenl on older sludenis Studenis over Ihe age of iwenl> five 
increased from four lo h'uk pcreeni of the student bod>, and 
Ihe plans are to grcally increase ihis percentage Of more 
concern r i{ualil> of ihc sludent The percentage; of acceplcd 
students has risen rapidly In 1965. ihese college:, dceeptcd 72 
pewnl of Iheir applieanis Now they accept 84 pcrceni Con- 
seifuenlly, ihe SAT '^orcs of entering student.* arc falling more 
rapidly ihan ihe national average (10 vs 6 percent) 

fjqufd ity, The hi^uidily measures attempi lo assess cash 
[low irends and Ihc vulnerabilil> of ihe sample inslilulions to 
short term creditors Table I displays ihe average consolidated 
balance shcci for all institutions and is adjusted on a per 
studeni basis Examining this table, one notices thai hquid 
asscis only grcw 36 pcrceiil while short-lerm debt increased 
157 perceni More to Ihe point, ihc average hquidmtiodecltned 
from lo |3 ^ Or. perhaps even more germane is the fact lhal 
m **)75. between *5 and 20 percent could not meet ihetr 
currenl obhgations even if Ihcy lnjutuaied their entire endow- 
ment Obviously, ihcrc is a serious and growing cash -flow 
erisis al ihese small colleges 
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Oebt structure, Calculaling from Table I . average debl 
as 3 percent of average equily increased from 26 perceni m 
l%5 to 36 perceni in 1972 li remained al 36 percent m 1975 
So. while Ihe average debl lo-ef]|uily ralia* vvasslighlly higher, 
the Irend Is ihe same Dcbl burden has increased from 5.2 la 
5 6 perceri Moreover, because of the inclusion of balloon 
paynftents (payments whieh trtcrcasc wilh time)* ihus pepLentage 
is cxpecled to become larger Average debl as a perecniagc v>f 
Turronl Fund lncomc.\ however, has declined Ml perceni to 
t02 perceni 



To summarize^ the average msliiulion has signitkantly 
increased ils debt since l%5 bul not in recent years Since 
1972, there has been j general rclu^lanu: lu assume long-lerm 
debt. However^ as noted earlier. Iherc is incrcasiTig dependence 
on ^hort-term debt to finance tlie summer cash flow. 

Resources* An importani measure of the financial irends 
of private colleges is ihal of et^uily or net worLK. E<|uily. a 
measure of owner^bip^ repfe. nti the reM)urces an inslilulmn 
can bring lo bear on ihe education of students. In this regard, 
total ei{uil> is more important than tolal dssels because the 
assels may be funded with debt* and ihe debt must bc serviced. 
With the exception of the current fund, the Irend is uniformly 
upward. The large gam in Ihe plant fund is nol unexpected. 
Spurred on by nsing enrollments and low interesi federal 
loans, most of Ihese colleges increabcd theif plani rapidly in 
Ihe 1960s. Mandatory repaymeni schedules insure the payment 
of plant debt with concurreni ac^rclion of plani equily. The 
size of Ihe increase in endowment was nol fully antieipaled. 
However^ as noted previously, ihe trend in book value does nol 
necessarily mirror the Ircnd in markel value. For aboul half of 
ihe 40 inslilutions. informalion on markei value was available. 
These data reveal a rapid nse from 1965 lo 1972 and Ihen an 
equally swifl dceline in 1975. 

Although euneni fund equily is a minor portion of loial 
equity, il IS significant thai il has declined m> rapidly. In 1965. 
12 percent of Ihe study colleges had negative current fund 
balances. By 1975. this siatistic had nsen to 38 percem. To 
some extent* Ihis sialistie may rcprcscnt a random reassign^ 
meni of funds from one group lo anoiher. Or* ihis change may 
parallel and be symplomatic of, cash flow problems. Thai is^ 
at Ihe end of ihe year iherc aie nol enough assels in ihe current 
fund 10 meel euneni obligaiions. 

The average loial equily per sludem has increased ai an 
annualized rate ofaboui 4 perceni. Colleges, however^ do not 
depreciale their capilal assets* and ihis obviously biases Ihc 
Irend in an upward direction. By assuming a forty-year life on 
plant and equapmenl. loial cquily is incrca.sing at a much 
slower rale — about I percent per year since 1972.* 

Summarizing, average resources have nol diminished. 
Ralher* ihey appear to have increased slightly — even if adjust- 
ments arc made for enrollments and for deptecialion. However, 
one should bear in mind lhat ihese arc average dala. Thus^ we 
can esiimalc thai tolal resources arc dcelinir^ for a signifieanl 
minorily of ihese colleges. 

Operating position* Table 2 arrays ihe average current 
fund income and expcndilurcs per sludeni for all 40 colleges 
and tnJicales lhat both costs and income per sludent arc rising 
fasier at ihese colleges ihan ihe Higher Educalion Price Index 
consirucied by Halsiead (1975). Insiruclional expcndilurcs. 
however* have rcmatncd rclaiively stable. In addilion* ihe 
student- faculty ratio rose from 14 to 16. The most rapid rise in 
expenditures has been in sponsored research and progranfis. 
although ihese activilics slill rcprcsenl a small part of ihe 
budgei. Both expcndilurcs for siudenl services ^primarily for 
the admissions office) and smdem aid arc nsing rapidly. Stu- 
dent aid expcndilurcs. as a perceni of tuilion^ has incrca^cd 
from 12 to 16 percent. The changes in sludent aid and admis- 
sions, of course* rcOe^l ihe vigorous efforts of these college% 
lo keep up cnrollmenls. Administration and mainlenance also 
show si/able incrcases. However, when maintenance expendi- 
tures arc cone^lcd for plani si/Ot ihey decline from 4. 7 perceni 
ofplanl book value in 1965 to 3.4 perceni in 1975. 

The percenlage of income from ludion has been rclaiively 
stable ai 66 perLcni. Oulsidc mcome igifts and granlsl has 
n&en* v^ilh govemmcnt being the pnnie source TItis is evidence 
of ihe incfe4sing dependence of ihese colleges o i ihe stale and 
federal govemmcnLs. Morcovcr. these dat^i understate ihe Ircnd 
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bcciiuso of tbo JncTt;a^(ng number of sluJcnts ^ho rcceiic Mjtc 
Mi} fcilerdl asM5,taiicc The source of thcM; fuiuiv is noi JekxtcJ 
by tnsltlutional accouniing methods 

Both auxtliar> mconie and expenditures per sluJent have 
dechned This vu^gesis thai these i^ollcges hjvc beioine more 
dependent upon commuter sludcnU than Ihejr dircu responses 
would mdieale 

Turning lo the often cUed surplus/deficit mfomution* the 
reader vt\l\ note thai ihci^ arc ihrcc surplus/dcrtcii eakuiaiion!>. 
The flnit exclude!) all iransfcrs The soeond im;ludcs on!) 
mandatory lran^^e^s And the ihird lakes jnto au;ount bt>th 
mandaloi^ and nonmandaloi^ iransfers^ Tiic AlCPA audji 
gutde h resound I ngl) sileni v^iih regard i:> the dcHnUjon of 
surpluses and deHeitv The author's pncfercace is lo include 
onf> mandator) transfers Using this :^uond caLuiaiJon,. une 
notes an aggregate, bui dimmishing,. surplus. 

In sum, ihc operating budgets of those colleges are being 
squeezed Mone> thai might have been m the instructional 
budget ]s being diserted into the effort lo recruit ^^tudents. 
Maintenance as a percent of plant salue iS falling Wilh regard 
to income, outside S4>urcCs. particularl) the government, ba^e 
provided important relief 

Sommary 

The purposes of this paper ^^ere to present a model for 
assessing snr^all ec^llege niianciat health and to provide com 
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pardtisc data for use b> uthcr small colleges The sccot)d 
objective requires little comment. An average consolidated 
batanee ^hcet and an average income and expense Matement 
v^ere included in this report, Jon^ MVith other ^elcc ted slatl^tJLs. 
While space prt*^luded a more complete set of data.* thc> are 
available (Anderson. 1977^ Perhaps ihe first c*jcetive could 
best summarized by as^rsstng the financial analysts with 
v^hal might hase been achieved if onl^ the operating budget 
and enrollment had been examittcil^ 

A review of fulMime equivalent (PTE) enrollment Mvould 
suggest that these i^olleges have been able to Mabilize enroll- 
ment. However, b> revte^ving Scholastic Aptnude TesttSAT) 
scores, the age distribution of students, and the percent of 
students accepted, as well as b> ^evte^^tng the increased ex- 
penditures on student !>crviLes (adniissiuns) and student financial 
atd, it becomes clear that this enrollment stabilization VkVci> not 
^^ilhout a price. While these data do not provide a complete 
analysis, they should provoke further stody. Indeed, part of the 
full research project ^^as to asse^^s environmental trends. The 
result of thiS rcscarvh showed thai those colleges ^^hich ^verc 
most successful in maintaining or increasing enrollments ^^ele 
alM> the most likely to :fhow ileelines in sense of eommunity, 
campus morale, and faeulty-student relationships, as measured 
by ehanging CUES scores ^ Although <>f"^ must be cautious 
about generalizing, the results clearly indicate thai the measure- 
ment of demand is far more complicated than counting students. 

Probably the most significant new aspect of college finance 
uncovered by this analysis is that of the increasing liquidity 
problem. The (lex tbUtty, even the existence, of many of these 
eojicges, is threatened by the relative size of their shon-ierm 
debt. While total debt has stabilized, shon-term debt continues 
to grow . However, not all of the institutions in this study have 
brought their total debt under control. A few colleges in this 
s:udy were icchnically insolvent (total debt exceeded total 
assets). None of this information would be available from 
HEGJS reports or from the income and expense statements. 

One bright spoi was the increase m fiscal resources. 
However slight this increase was. it indicated that most of the 
eolleges have some resources for reorienting their efforts. 
Again* these data arc not available from HEGTS reports or 
from operating statements 

RccommendatToOs 

Although this report has implications for the operation of 
small private colleges, it ha<i enncemratcd nn informational 
needs and fom>ats The iec<immendat)ons will be similarly 
inclined. 

College presidents and financial officers must consider 
both intcmal and external financial mformation need^ With 
respect to both reporting rcqutrciiicnis, these officers should 
give lOore constdenition to consohdated financial reports, e.g.. 
grouping fund data. This is not a recommendation that current 
repDrting practice^; be abandoned^ The con vent tonal reports arc 
wcll-smtcd for the fiduciary responsibilities of the colleges and 
universttic!,. Moreover, those reports have the vciy real ad 
vaniage of faiiiiliartty. at least to many people. The fomiat of 
the ennvcntional reports, however, focuses adminisiraitvc. 
trustee, and staff attention dispmportionatcly on the current 
fund sutplus and deficit A cons4)ltdated report would expand 
the attention of the c'oneerned ctKPsiituencies. Ti would high- 
light * forcxatnple^ an incipieni cash flow problem — infonnation 
that is critical for many of the eolleges m the study reported 
fiere AdiinnisU"ator\ whi> wish lo develop a consohdated reptvt 
should Consult the m(x)cl developed by Jenny < 1^7.1) or examine 
the fiiianeial statement of the UnivcTMiy ot Kwhesicr 

In spite of (he available models, change will not l>e easy 
College financial adtiiinistrators who wish to loiprove ihe 
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utility of their financial reports will be tianipcicti by ihc sianJanJ 
reporting conventions on the one tiami ami tite lack ofconscnsus 
for reform on the otticr Tt^ Amaican Institute of Certificil 
Public Aecountant^k lias made significant rcnncmenis in the 
accounting and reporting practices of colleges and universities 
Bu^ne^ officers (NACUBO) are, however, reacting in a 
generally negative way to a proposal by ih* AlCPA for more 
s^weeping accounting changes Many of tbebe cntici^ms have 
mertt Still, college business officers must f tee the fact that 
self-imposed accounting improvement have been relatively 
insignificant. This must be changed Professional associate om^, 
researchers, and business officers ^fhould develop meaningful 
accounting conventions which can be used by alt, or at least 
large groups of colleges. 

Punher, researchers must work to develop, test, and 
standardize more meaningful statistical measures of financial 



health. This paper presented a few of the measures that have 
been adopted from security analysis. Standards were provided 
for private liberal arts college:;, U is hoped that these measures 
will be tried, cnticized, and improved. Separate measures 
should be developed for public institutions and large private 
Universities. 

If institutions of higher education ate to reiain public 
confidence, they must improv* their repotting techniques and 
methods of analysis. An accounting system closest lo the 
corporate model and related analytic tools used by security 
analysts can help. College business officers, researchers, and 
pnpfessional associanons should act now lo help shore up 
sagging public confidence. College and umversitte^ ate not 
listed on a securities exchange.i bui their stocks are, indeed, 
traded publicly 
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For jnMilutional planning to innpacl policies and resources 
efTccli^el)* U should be a comprchcnsivei continuous* and 
^>&tennatk process invoking the broad participation of the 
university community. A planning process evaluntcs the past 
nnd present, antieipates the future^ and formulates strategies to 
jihape the future of the tn^ftitution. Planning should influcnee 
the ba^ie elenv;nts which comprise a university — missions, 
eumcula. personnels faeilitieSi and budgets. These elements 
need to be analyzed from the perspective of how they interact 
with eaeli other and with constraints extemal to the institution. 
The result of the planning process is an annual, or pcnodiCi 
master plan for the institution projecting for a stipulated time 
into the future. The planning effort should provide greater 
eohercnce in, and understanding of* university decision nfiaklng 
in a^dre^^ing policy issuer and resource allocation and re 
allocntion. 

The discussion which follows describes the essential ele- 
nents of a planning process and Resource allocation modeJ adopted 
by a public four-year university wjthin a eomple^t system of 
higher education. U also illustrates some of the outcomes of 
the process after several years of implementation. 

The Context for Planning 

An essential prccondiiion for effeuive planning arc ^ate 
mcnts un in^i'iitional mission^ planning 4asumpuonsi and 
university goals. It h important thdt th^^ statements be pub- 
lished and diMributed tu the campus community prior tu c^^h 
annual planning cycle so that all constituencies kno^ the 
paranfKters within which to pUn. Each of these statements is 
defined here with illustrative samples. 

institutional mission^ Almost eveiy untversity has at 
least one mission or purpose statement which has been de- 
selopcd by the institution, or a board of tegents if the institution 
Is part of tomplcx nulti -campus system. These statement> are 
usually broad and eomprehcrisive and are long-range in inten- 
tion. Sample mission staiements are: 
e Provide a base of libera) studies as (he foundation for uni- 
versity degrees In the arts and letters and sciences* as well 
as for specialized professional and occupational degrees 
at the baccalaureate leveL 

« The university should offei graduate education m the art> 
and scrcneeSi in business administration, in teacher edu> 
cation, and in programs growing cJearly from areas of 
undergraduate emphasis meeting jdentified regional and 
state needs. 

planning ar^umptlons.* PInnning assumptions refine the 
context for planning for five to ten years and the pnmaiy 
service aten of the untversity. The assumptions arc selective, 
rather than eomprehensivcr nnd ^re updated each year. Each 
nssumption is chosen for its rclationship to univ^ersity mission 
U;itementsnnd potential effect on the university. Sample plan* 
ning assumptions are: 

* Enrollment of FTE students vvdl increase mo^ rate U until 
1980 iind then decrease significantly for at lea^i a decade. 



• PublK funding aiM probably, lU best, remain at present 
levels and mny even decline in the futurc on aper-Mudent 
basi>. Re>ources ^or change and growth wdl, therefore, 
have to be made from base reallocation. 

University goal$« University goals are formulated from 
mission statements and ptanring assumptions. The goals are 
ends toward which effort is directed and provide a basis from 
which planning units wtthin the university develop their specific 
objectives The university goals are by design and necessity 
less comprehensive and take a shorter rang^ view than mission 
statements and planning assumptions. Sample university goals 
are: 

• Pragram development and support — Tlie university wdl 
initiate neur pragcam> and modify existing one> m merging 
areas eon sistent with student needs and university strengths 
at the graduate and undergraduate level, 

« Accountability and effieiercy— New systems of collecting 
and dis^minating information wiJI be developed to insure 
accountability to various publics about the university 
programs and operations* incrcase efTleieney, and maxi- 
mize administrative support of instructional programs. 

Unit objectives* Planning units (defined below) objecUves 
^tth resource tmpU^ations arc developed during the planing 
process. These arc very specific statements^ usually having <jnL 
or two year duration. Bach unit objective supports at liast one 
university goal. Sample planning unit objectives aie^ 

« To establish a Master of Arts in Humanities degree which 
involves the departments of English, art, and music in the 
College of Letters and Science. 

• To provide the pubJiu ^ith eastcf access by locating the 
Continuing Education Djvisiun in a central and visible 
physical facility. 

There are sever£»l types of planning untts. These are 
defined here to assist the rcader in comprehending the extensive- 
ness of the planning process, 

Coiiege planning units consist of faculty^ students and 
administrators. 

Division pianntng units consiM of untversity support 
personnel, 

Basic planning units are either academtc ^departments 
and programs within a college) or university siipport (i^ffices 
and centers within a division). 

Self-determined planning units consist of two or more 
fnculty or ftaff not currently in the same pbnning unit who 
have common program objectives and wish to develop a plan- 
ning proposal intended to better rcalizc those objeetivcj^. (This 
faeiliiates interdisciplinary and inteninit planning,) 

The Plannlt»g Process 

The process is programmed in Figure I and displays the 
flow of activity with a time schedule from imtul distribution 
of the Guide to Planning to the completion of a one-year 
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Figure K The planning process. 
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planning cycle Next, each major step tn Figure I is explained 
briefly to assist in vi'iualizing how the process culminates yearly 
in an upilaieJ institutional master plan which determines re- 
source allocations and reallocations. 

September. Early in September^ colleges and divisions 
distribute their objectives to constituencies for reactions. Later 
that month* they make revisions and distribute the final objec- 
tives to their basic planning units. 

Also.* early in September all data to assist planning units 
in developing their planning documents are distributed by the 
Office of Planning and Institutional Rescaarh (OPIR) and the 
University Budget Office (UBO) Data for planning consii^ts, 
in part, of student credit hour production, faculty staffing, 
program majors, degrees awarded* class size analyseSi and 
unit !;tit>pon costs. By the end of the montht basic planning 
units review the data provided to them and consult with their 
respective deans Or division heads to reach agreement on any^ 
neccs!;afy revisions so that a common data base for the institu- 
tion exists. 

Near the end of September, a planning steering committee, 
consisting of facultyt administrators* and students is named 
and charged with oversight rcsponstbiHties in evaluating the 
planning process for the current year to improve the n^;xt 
cycle. / 

During this month, self-determined Juntts (SDU s) also 
declare their ph ning intentions to appropriate chairperson Si 
deanst and university support division heads.' 

October, Basic units and SDU's d'tsctiist with appropriate 
(.'canjs and division heads, the impact of fheir plans on staffmg, 
budget allocationSt graduate assis^dt requests* and physical 
facility improvement requests By the middle of the months 
basic and SDU*s submit fir* ' ^vlanning documents to respective 
administrative heads anc ite vice chancellor's offrce. (Con- 
stUuents within these ufiits review the draft plan before it is 
^nt to the ncxtjii^hcr administrative IcveL) All planning 
documents are advisoiy until the institutional plan is approved 
by the chajtcellor, 

^oVemberi Colleges and divisions develop draft plans 
and distribute copies to all basic planning umts for review and 
comment. Colleges and divisions are required to list priorities 
for new academic programs* graduate assistantship assign* 
mcitts, and physical improvements as part of their planning 
documents. By the end of the months reactions to each untt are 
feccLVL'l and integrated into the final plan. 

The college atui dtv^&ion planning statetncms arc dc^ 
vcloped m a way similar to that of basic units, and the plan 
reflects an analysis and synthcsisof the plans of its basic units. 
Colleges and divisions als * establish program/ function pnor^ 
ities by usii^ uniform criteria. Colleges use quantitattve cntena 
based on institutional data developed by OMR and UBO as 
well as qualitative cntena* Congntent with those in the Guide 
to Planning* from the vice chancellor and as approved by the 
college planning committees University support divisions do 
not follow a uniform set of criteria because they are quite 
diverse in function, Howcvcri division heads are required to 
identify criteria ele^jly so that baste units know by what 
performance criteria they wtll be evaluated, 

December. Early m the monthr the Deans Counctl in a 
series of open mcctingschaincdby the vice chance I loTt analyzes* 
discusses, and makes recommendations conceming college, di- 
vision, and SDU planning of documents. (The Deans Council, 
during these sessions* consists not only of deans but also of 
division heads.) The objectives of caeh college and divi^ 
Mon* and 'heir resouri.e implications, are assessed in light of 
university* wide needs The council then endorses* modifies, 
or denies planning intentions and requests. 

At the conclusion of the "tC.vsions, deans and division 



heads communicate recommendations of the council to their 
constituencies. At the same time* decisions to fill vacancies 
and any new positions which can be clearly authorized for the 
coming year are announced so that the recruitment process can 
be immediately initiated. 

January* in its planning document, each college and 
division planning unit update^ tts bajLc units and its own 
''abstract' ' section statements to reflect decisions reached dunng 
the deans council planning sessions. Those abstract statements 
are an important part of the institutional plan. 

By the end of the month* the draft institutional plan is 
completed by the vice chancellor and staff and distributed to 
all faculty* staffs and studeiri government members* with added 
copies placed in the university library. 

February. By the middle of the month, each dean and 
division head* joined by ihe vice chancellor, holds meetings 
with constituent groups to review the draft institi^tional plan. 
Written comtnentb on the draft instiUittonal plan are ctieouraged 
and sent to the chancellor, 

Near the end of the montht the chancellor convenes 
governance and admintstrativ^j officers tu consult in making 
final decisions on the draft ntstitutional plan. The chancellor 
also meets with the University Budget Commtueei which 
consists of faettltyi students, and staff* since the university^'s 
budget and internal resource allocations are based on the 
institutional plan. 

March* The final institutional plan in completed by the 
vice chancellor and staff and* after approsal by the chancellor, 
is distributed on campus as well as to selected external campus 
agencies, institutions* and associations, 

April. The Planning Steering Committee recommends to 
the vice chancellor and chancellor any revisions in the process 
for the next planning cycle. Governance groups are encour^d 
to suggest revisions in university planning assumptions and 
goals. The chancellor and vice chancellor then consult with 
governance and administrative officers to determine any changes 
in the next planning cycle atid to announce changes to the 
campus. The next year's Guide to Planning is then developed 
and distributed. 

Planning Outcomes 

At the end of the annual planning cycle in Marchi institu- 
tional policy decisions and resource allocations are determined 
for one year specifically and ff^r eight years in general. The 
comprehensive institutional Plan is the document reporting the 
aggregate resurts of planning, from the basic university sup- 
port and academic unit level* through the division and college 
levelt through the institutional level, (De^is Council) and 
review by all campus governance groups* to the chancellor. A 
few examples of outcomes from a receni year of planning 
follow, 

• The College of Education will be reorganized into aca 
demic clusters from depanmcnt structures. 

• Self-determined units (SDU*s), Alternative Futures, Cmi- 
muntty Arts, and an Ideal Educator Research Insittute 
will be supponcd within proposal resource projections 

• Continuing education and outreach activities will be given 
high priority designations for the future* since the tradi- 
tional college age pool is dcclining- 

« An Institute for Human Design will be established m a 
consortial arrangement with a state mental health institute 
geograpliteally contiguous to the university. 

• Faculty and academic staff position allocations will re- 
main the same* however* several position reallocations 
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>viihjn Ihc in^tnuli*"^ v^jII be nuJe t^^ reflevl program 
poor It ICS. 

After two coT^plete planning cycles, ttu ^ developmeits 
can be described as a result of Ihc prxKCSS First, many perkJing 
issues and concerns which had accumulated at the university 
tcvcl in recent history were resolved in the planning process 
Second, the univcrsity^s staffing and rescuiccs are nnorc clearly 
knov^ii now, and efTectlvc policies and procedures have b&n 
pvi in place to innplennent the instilutioial plan Thirdt (he 
quality of university progranns has improved through the con- 
tinuo*js and connprehenstve study and review re<iuired by the 
planning process. 

It was detcfmined from the substantial infonnation base 
compiled in the Hrst two connprehcnsive planning years that in 
the future an abbreviated planning cycle w^jid be appropriate 



Ln alternate >c<irs. Plantiitig documents mviH be developed by 
colleges and divisions rather than by basic units and then flow 
into a university master plat). While basic units will still have 
an opportunity to review and critique college and division 
plans, the prinnaiy thrust for development will come at the next 
higher administrative level. 

The planning process outlined her? should be applicable 
to many other universities which are intvicsted in devcl<jping a 
participatory management resource allocation model/* It has 
accomplished the purposes for whi^h it was onginally designed: 
more informed policy *e (;ions and resource allocations, where 
justified, r meet c i and projected circumsiances* and 
greater cohereni^e in, r,id understanding of, university decision 
mak:ng. As u ct^ there is a sense within the university that 
It has attempted to shape its future with greater vision. 
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Research /nd scholarship majof functions of ^ uni\cr^U> 
well as necessary and integral pans of graduate education. 
Federal support of univer?ity-based research and changes In 
support diff'^Fv^ntially affect the departmcniS that offer graduate 
education. Wiiat is Jacking is boih tiie means for asscssii^ the 
total federal impact on ^Mduate education and a means for 
exercising a reasonable innuenee over the direction of the 
effects (National " "ird on Graduate Education^ 1974) This 
paper summiiH^jzes <t study conducted on the impact of federal 
funding for university research on graduate education and 
research between 1969 and 1974 at a large midwestem uni- 
versity (Girves. 1976). 

Both the level and the composition of federal funding for 
university research have shifted over the past thirty -five years. 
The number of federal dollars expended for university rest^arch 
inerca!>ed dramatically from 1941 to 1964 and then leveled off 
through the late sixties. Gtven inflation, .he real dollar funding 
levels between 1970 and 1975 were *^ss than those between 
1963 and 1969 (National Science Foundation. 1973). Although 
the funding levels increased durfng the sixties* federal research 
dollars were spread among more disciplines and amoi^ more 
universities. 

Dreseh(l974) points out that the shifts in the composition 
of fedetal support may ultrnately be more scnous to the 
graduate education system than shifts in the level Of support. 
Increasing federal ■ ^ppon has gone to applied rather ihan basic 
reasearch. Contracts, which tend to be shon-ierm. as well as 
restricted to a specific problem and initiated by the federal 
agency, are repfacmg research grants, wh :h tend to t>e loiig- 
temi> flexible, and almost entirely imtiatec^ by the investi'^ator. 
This ^hift may afTcet the nature of the research perfor :d in 
the university and the nature of the relationship between re> 
search and graduate education. 

Orlans (1962)* Pusey (1962 and 1963). Dressel and 
Come (1969) and NSF (1970) studied the impact on universities 
of federal support for sponsored research. In each case, uni- 
versities were ^ed according to the number of research 
dollars received Ot^ly NSF corr K'd individual disciplines. 
These studies largely focused on i'k ,imilanties and differences 
an'ong groups; of universities uithin broad academic areas 
None gave a comprehensive vic.v of all the disciplines engaged 
in graduate edgeatlon The graduate professional disciplme^ 
were omitted altogether None anat>7Cd tiie interrelationships 
amon^^ the disciplines within one university. 

This study focused on the relationship betwee: shifts *ri 
rederal funding patterns for university research and ^^h m 
graduate education add research conducted within the Hfty^ 
five departments which offered the Pl> D. degree between 
1969 and (974 in a large midwestem university The selected 
departments fall into nine are^s which essentially Represent the 
organization of the colleges in the university. The areas are. 
( I ) administrative sciences. (2) agriculture ami home economics, 
(3) arts and humanities. (4) biological ^eicnecs* (3) education. 



(6) cngineenng, (7) mathematics and physical ^lencesi (8) 
medicine and (9) social a..d behavic'al sciences. 

Data Collection 

Existing data recorded routinely in various university 
offices were collected by department for fiscal years 1969 and 
i 974 or for autumn quarters in I96S and 1973. whichever was 
appropriate These data included ^search activityi budgetary 
information by source and category. p<^rsonnel information by 
v>urce and category, and graduate student enrollment and 
support infoimation. A dr^mrtmental profrle summar^irig these 
data was prepared by the researcher and sent to each depart- 
ment chairperson for review. 

Then, each department chairperson ^ as interviewed. The 
questions focused nn the nature of the research performed in 
the department, on the relationship i>etween research and grad- 
uate education conducted within the department and federally 
funded research, and on the impact of the shifts in federal 
funding on the faculty, students* and the graduate program. 
The chairpersons commented on the data provided and gave 
possible explanations for any ch^^nges that occurred over the 
five-year period. 

Ir addition, questionnaires were sent to I ^216 graduate fac- 
ulty members: 58 percent responded The faculty were asked to 
estimate the amount of time they allocated to instruction* 
re^^earch, and service and to comment on the necessity for 
federally supported research in their departments, their success 
in gaining rese m;h dollars* any influence exerted by the funding 
agencies over the direction of their research* the quality of 
incoming graduate siudents. the quality of the apprentice/mentor 
relationship, and the overall impact of federal support of 
departmental research on the graduate pro ^^m in their 
departments. 

Analysis 

Both the institutional data and the responses to the ques- 
tionnaires were grouped by area and were analyzed usirig 
simple descnptive Satisfies* means* pereentages* and percent 
changes. The institutional data, along with the faculty estimates 
of time spent on research and graduate instrucnon* were also 
analyzed using canonical eorrelattons. The canonical correla- 
tions between the set of Sn^ven federal funding variables and 
each of the five subsets of the thirty-four graduate education 
and research variables were computed for each frseal year and 
for the changes occurring between them. Table I presents the 
six sets of variables. Table 2 presents the canonical correlations 
between the of federal funding variables and the subsets of 
the graduate education and research vanablcs. ^t>ce Girves, 
1976* for both the presentation of comparisons by .-ta and for 
the displays of each paired set of linear cc'mbi nations (n the 
canonical conelotions.) The remainder of this paper highlights 
and disi,u^ses the results of the analyses m relation with the 
perceptions of the ocpar^ment chairpersons and the facuhy 
members. 
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Table I 

The Stx Sets or Vanables Used in 
Computing the Canonical Conelations 

Federal Tunding vanabtos 

1 Number of research pfojccis 

2 Number of agcacies providing support 

3. Number of iti^aich projects funtted by the pnrtiaiy agency 

4 Satarics 

5 Equipment dollars 
6. Travel doJIars 

'7. Totally rcttcrally funded doNars 
GraJu3ie eJucanon and research \anables 
A Re^aSrch activity vanabks 

1 Number of nonrederal ticsearch projects 

2 Number of nonfederal agencies providing support 

3 Number of research projects funded by the nonfederal 
pnmary agency 

4 Number of graduate msirtiction hours 

5 Number of research and scholarship hours 
B. GjadU3te student character! sties variables 

I. Qu al I ly—undof graduate grade potnt average 
*3 Nunflber of first-year enrollmenis 

3 Number of fuH-tim-^ enrollments 
*4 Number of part-time eniollments 

5. Registered quarters afier the Gervenal Exaniination 

6 Nonregistered quarters after ihe General Examtnation 
•7. Number of docioral degrees conferred 

C Graduate student ^upport vanabtes 



Number of fellows and trainees 
Number of re^aieh associates 
Numlte^ * ■ le^^'.ing associates 
Nuniberol *'0'her-" 
Number federally supported 
Nuimbcf nonfrderally supported 
Number university supported 
Bu'' et 

*l Umvcrsitj -funded salaries 
2 Nonfedcrally funded sji'/ies 

*3^ University- funded equipment dioliars 
4 Nonfcderally funded equipment df>ltars 
5r (Jniversity*funded iravel dollars 

6 Nonfederally funded travel dollars 
*7 Untversiiy* funded total dollars 

8 Nonfederally funded lotal dollar^ 
Personnel variables 
I Number of instrttctiOnal staff 

Number of univcrsiiy- funded A&P siaff 
Number of federally funded A&P staff 
Number of noofcderally funded A&P staff 
Number of univcrvny-runded technicians 
*6, Number of federally funded tee^ieians 

7 Number of nonfederally funded t^Jchnieians 



•2 

*3. 
4 
5 



^Thcsc 'welvc graJvate education ami rascdtch van^r' ci^nibited (tic 
hr^t\^ corrctattoits (all gfcaicr thftn 70} jtuh iheir rc\pcciiv« ^^nifi- 
fant canonical va;iak\ when the differanc^s between FV t96{r jhd 
TY 1974 were anaiyjtcJ The cj^'jiUfcat conelatjon between Ibe dif- 
fidences in Ihe \tt of redc;ral funding vaftabte> was SS. whtch 
stgnific;tnl at Ibe 01 level 

Results and Discussion 

According to the d^'parttnent ellain>crsons and the faculty, 
the nature of the rosear- ^ activity is a major factor in detennin* 
ing the necessity for outside funding. When tt i^ neeJedt ihe 
graduate program expcriencod by the individual student, as 
well as the research perfornficd by the faculty* v/ill be affected 
Rescareh conducted in the scienceSt for example, requires 
substantial investments in equipment. Mippties* and personnel. 
Graduaie students in these dcpartrnef^ts are often supported as 
research associates for ongoing research projects Tlieir div 
scrlation^ arcustially part of ihe overall project. Consequently. 



a major portion of a student's research experience* which 
provides the basis for the student's future research activity, is 
detennined by the research projects that do get funded 

At the other extreme^ research conducted Jn the arts and 
humanities requires time aad travel money. Research in this 
area is an individual activity. Students arc supported as teachiag 
associates. Their dissertations arc indepaident of their teaching 
responsibilities and are often independent of the research per- 
formed by their advisers. 

While over 90 pciccnt of the faculty respoading to the 
questionnuire engaged in niscarch or other scholarly activities 
during 1969 and 1974, the percent who eng^ed in federally 
funded research varied dramatically among departments and 
declined between 1969 and 1974. Although inost faculty said 
that they did not perceive any influence by federal funding 
agencies ovei the direction of their research, those faculty m 
engineering and in the biomedicjtl sciences frequently reported 
that federal agencies had influenced the direction of their 
research. Some iivdicated that proposals weic written ''cos- 
mcttcally;'' others modified their fH:Kus from studying a par- 
ticular aspect of a rtormal cell, for example* to studyiiig the 
same aspect of a cancer cell, few changed directions entirety- 
Faculty in the arts and humanities* on the other hand* com- 
mented that increasing fe'^ni dollars pro vtdco a focus to the 
research underway. 

Faculty members in adm mist rat tve sciences, arts and 
humanities* biclogical sctences* education and social and be- 
havioral sciences generally reported increases in the amount of 
^lescarch they perfonned The faculty tn engineering* mathe- 

Table 2 



Summary Table of the Canonical Correlations between 


the Scl of Federal Finding Variables and Bach Subset 


of the Graduate Education and Research Variables for 


FY 1969, ?V 1974 and the Differences 




between FY 1969 and FY 1974 
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n^olirs, and pbysi^-^ sciences 4ml mc^kinf rcpi>riccl decreases 
\n addition to clringcs in federal funding patterns, the faculty 
dlso cited changes in their own interests and hck of time 
rejsons for ^hanj^es in the amount of research they produced 
OverjII, however, the relative amount of time expended on 
research by faculty ren(>aincd aboMt the same for 1969 and 
1974 Department chairpcr!>OiU and faculty meml>crs alike 
indicated that in many disciplmcs reduced research productivit) 
was due to the increaM,'d competition for fewer federal research 
dollars There was no relationship between the extent of in- 
volvement with federally funded research and the amount of 
time allocated to research activities 01 to graduate instruction 
These two variables did not contribute to the significant canon^ 
leal correlations ( 77 in 1969 and 75 in 1974) between the 
research activities and the federal funding variables. Involve- 
ment with nonfederal!) funded research contributed stronj* I > to 
the relationship 

The reputation of the department\ research capabilities 
as perceived by faculty at other universities and the avisjlabiht> 
o( Hnaneial suppurt were given by department chairpersons a^ 
the two m;yor reasons why graduate students were attracted to 
particular departments As a result, faculty from thos? depart 
ments that were heavily involved with federally funded research 
perceived a strong n'lationship between federal funding and 
the quality of the MudeMs they attracted Those faculty from 
depaitiiients that were not involved with federally funded 
research saw no relationship between the quality of the students 
attracted and fedc funding Motivation and preparation v^ere 
given js the important indicators of student c]ualUy Changes in 
incoming gnnle point averages weio nt>t assocta;ed SMth chan^jes 
in the federal funding variables 

3oth the type and source of student support shifted be- 
tween 1969 and 1974 More students were supported by uni- 
versity fund>» and teaching ass^iates in 1974 Involvement 
with federally funded research was sfongly associated with 
support of students The canonicatcoiTclation v^as $8jnl969 
and 9| in 1974 In general, as involvement with fedcrall) 
funded research declined, the nunibcr of research associates 
dccimed and the number of teaching assiKiates increased. 
Chairpersons and faculi> were concerned that the shift a^^y 
from research appointments would Mndermine the preparation 
und training A the future scholars in their disciplines 

Those departments thfit were heavily involved with fed- 
erally funded research tended to he associated with high first- 
year full-time and part time gtaduate enrollments As their 
involvement with federally funded research declined betv^een 
1969 and 1974. their enrollments also declined (the canonical 
correlation equals 78) New graduate student enrollment pat- 
terns were eiitergi ig in 1974 More students enrolled part- 
time More were enrolling in the professionally oriented dis- 
ciplines Both the lack of available support and the perceived 
poor job market accounted for these shifl> In effect. socicty\ 
perceived needs were being reflected by the lack of federal 
support for graduate students in many disciplines 

The uncertainty surrounding federally funded research 
was very disturbing to the department ehairpcisons Internal 
planning hccaiiie virtually' hnpossible PeJeral research dollars 
rid suddenly and unexpectedly he eliminated or drastically 
reduced Personnel lured to support a research project would 
have o he let go. vipportcd on another project, or supported 
6y the department At other times, funding would suddenly 
hccoine available but would have tu he spen* wjthin a shurt 
pcno<I of thne Commitments to support i'*^duatc snidents 
often e<iufd not be made until fate summer, aftei tTiany students 
had made other plans TItese problems createc' frustration, 
low morale, and inefficiency The faculty nteuiber and the 



department chairpersons in the biomedical sciences were at- 
fected the most severely. 

This uncerlamty was due. in part, to the apparent shiH. 
between 19o9 and 1974. from awarding research grants to 
awarding research contracts. Many perceived these contracts 
as being restrictive, short-term, and less suppurtive of the 
educational aspect of research performed in :i university en^ 
vironmcnt. Fewer ^radu*ite students were supporticd as reseu:eh 
associates tn favor of full-time teehtiicians 0{ those who were 
supported as research associates, many were supported on 
short-term projects. Consequently, the continuity of thcjr re- 
search experiences and of the research elforts of the faculty 
deteriorated 

Those depaitmenb heavily involved wjth federally funded 
research, pariicularly those in engineering, tended to have 
large Hnancial eommjtmentb from nonfederal sources as welt 
JS from the university in a*!"^ ' ^e financial commitments 
from the university in 1974 Decreases in fedetally supporteo 
research were associated ^vith decreases m nonfederally sup« 
ported research and mereases from the university. 

As with the departmental expenditures, mvolvemeni with 
federally funded research was strongly associated (r=.99 in 
1969 and .98 in 1974) with the number of personnel supported 
in 1969 and 1974. particularly those supported from federal 
and nonfederal sources as technicians or administrative and 
professional staff. The university^ supported personnel showed 
a inueh stronger association with involvement with federal 
research m 1974 than in 1969. Overall, the number of instruct 
tionat staff. A&P personnel and technicians declined between 
1969 and 1974 The change m number of technicians was 
closely tied to the change in number of research projects 
underway. 

Faculty members were asked to indicate the primary ef- 
fects OR thetr graduate program of shifts in federal support ^or 
research and scholarship between fiscal 19t>9and 1974 Forty- 
seven percent said that there ^vas (ittle or no effect on their 
graduate prog.ani. Fort>-two percent reported negative effects 
of shifts in federal support for research. Lack of adequate 
graduate student support was the most eominon negative effeet 
given. Without such support, it is difficult to attract top- 
i^uality students And, if fewer graduate students are supported 
as re.sciireh associates, fewer g^duate students will have the 
opjjortunity to engage in researctj activities with the faculty 

Faculty n>cmbers in the arts an(t ^umanme.. in particular, 
noted that the elimination of the NDEA (National Defense 
Education AU) fellowship program not only reduced tlic num- 
ber of graduate students supported but also eliminmed the 
cost -o I -e due ado n dollars that iceompanted tho^ .^MowshipS' 
These unrestricted dtVlars had been u.sed to sU|iport student 
and faculty research activities. Many faculty members eom^ 
mented on the un^vanted strings attached to most federally 
funded research Thus, tlie cost or education dollars had been 
ideal for many di^partmcnts. 

Some faculty members and departmeiu c iirpersons sug^ 
gested that reduced federal support did have beneficial etfects 

on the groduaie program, Medkicrity would be cl nated and 

the overall quality of the research pr<.gram iiii|'.ht be improved 
Thtis. students would experience and e i^^ag^ in higher quality 
research a^ tivtttes In add*tton. it was argued that only those 
graduate students truly interested in learning would Ik; iiiotivcitcd 
to apply to a graduate program 

Overall, changes in mvolvtment with f*KUr.iily tunded 
rcsearun were most strongly associated tr-.titi) witnchapiges 
m the fi^llo^ving twelve inMitiltonal sa>^iables. {\} number ot 
research associates. (2) univers(t>-lijtiJed equipment dollars. 
(^) number (if federally supported gr;tduate students. (4) uni- 
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number of fcllow^ and tramec^^ 0> part ttme enrollment:*^ 
(3> first->cai onroltmcnb* (9j number of iiA.iv£rsit>- supported 
A&PpcrMinncL (1Q> number uf ani^er:>it> -supported tcvhnjcal 
pcT^onnel, H I) number of JiKtoral Jcgr^e^confeneJ^aniKlZj 
number of rederdll> ^upporleU A&P per^onnel^ Approximately 
42 percent of the ^anabiltt> among thc^ graduate cJucatign 
and research variables can be accounted fot b> knowing the 
federal Tundtng ^ariable^. In ^ummar>, iho^e departments that 
experienced decrea^d jn^okement with feierall) funded re 
search, except for federall> fundedira^cl, tciUed toCApencnce 
<i dcclme in the number of feJeralt) supportci graduate :>tudent:> 
and tei,hnicians along svith an increase .ii universit> support 
dnd tn the number of part-time and nrsi->ear graduate student 
enrollments. The increased part time graduate enrollments 
might be explajiicd b> ihe lack of finan^ ' ^ support whjch 
coutd result in man> students securing ^ 1. employment. 
Hosvcver. it vvould be expected that the firsi year c^nrollments 
would decline in these departments due to lack of funding. 
This picture describes ^vcral departments in mathematics and 
physical sciences in particular. 



The tcsults of this study indicate that dcpartnfKnLs, jndecd, 
are differentially affected b> federally funded research Al- 
though scleral departments svere not dffcctcd at jtl by change:* 
in federal funding, changes in the graduate education and 
re^aKh ^anables did Ml ^cur in them o^er die five year 
period. The nature of the research performed and* thus* the 
resulting involvement in federal rcst^ch are the primary factors 
in determining the extent of the federal impact on graduate 
education and research conducted in a department. The t^n 
ablcs included in this study v^tTc identified in the literature a:> 
being affected by federal funding of university rcseHitrch. In the 
future^ data on the set of tsveUe variables svhich coniributcd 
the most to the canonical conetattons should be collected er 
several years. The trends could then be determined for each 
variable ..d prediction equations could be generated. Then* 
perhaps, department chairpersons and college deans could 
design :>trutegies for handling and adjusting to the negative 
effects while tlic positive effects of fedcially :>upported research 
could be maximized. 
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Time-shortened degree prognuTj development an<J imple- 
mentation has re ved an extraordinary amount of attention 
during (he past years In 1971* the report of the Carnegie 
Commission on Higher Edueation entitl^^ Less Tinie> More 
Options* provided the eatalyst for change. Tbe report spoke 
speeifleally of shorteritng the time required for the baccalaureate 
degree^ first to three and one-halfyears and then to thiec years 
Bersi (1973) reported thai 243 colleges and universitks were 
involved in time- shortened program activities by j973. 

A variety of reasons have been advanced lo establish the 
need for and purpose of a time -shortened or three year bac- 
calaureate degree. Tbcse reasons include the following. 

1 As<iumed icduetions in university costs* at least in 
(crnts of the eo£t per baccalaureate degree 

2 Consideration of the lime-shortened degree as a vehicle 
for educational reform since it will force i thorough study of 
hoth high school and university cunricular offerings 

3 Tbe assumption that better articulation and coopera- 
tion between universities and high schools will occur 

4 Reduced costs to the individual student and family in 
paying for a college education 

5 The calloused observation from a govemmeT^tal point 
of view that the time-shonened degree pJaces an individual 
student into a salary earning environment and* therefore* on 
the tax rolls at an earlier time 

6 Tbe assumption that students are maturing at an earlier 
age and can handle the tigors of college level insuojction at a 
faster pace or earlier age 

7 The elaim thai senior high school and introductory 
university curricula consist of senseless and endless duplica- 
tion of efforts which sttfles student cunosity* enthusiasm^ and 
interest. 

Numerous attempts have been made to economize the 
time required to complete the curriculum lirading to the bac- 
calatireate, and a variety of reasons have been advanced to 
support the need for such a program structure. However^ 
program evaluation* when it occurs* has been limited to assess^ 
mcnts of grade point averages and success in college. 

Purposes 

The purposes; of paper are threefold: 

1 To contrast the intellectual development of time ^anable 
degree parttctpants with a control group of students vt.to por^ 
ticjpated in the traditional program 

2 Tocontrasttheaeademic achievement of time variab^ 
degree partii:i pants with a eonuol group of students who pai- 
tieipated in the traditional program 

y To present the findings ofa follow-up survey designed 
lo a<;scss the level of program satisfaction pnd perceived iniel- 
fectoal development of time variable decree and control group 
students. 

lllstoHeat Overview 

Both the structure and length of baccalaureate degree 
pmgrams have undergone frcqoent scrutiny nnd change tJiiough^ 



out the development of higher education in America. ]n the 
colonial period* college had a predominately religious orienta- 
tion which sewed the aristocratic groups by trainmg for a 
broad liberal culture and Christian piety (Brubacher & Rtidy, 
]96S). Today's universities are essennally secular* address 
social issues^ carry out scholarly research* and are eqiialitanan 
in nature. The nature of the collegiate envuorunent has changed 
as the needs of society have changed. In the l^t^ ntneteenth 
century* Clarence King reported that university requirements 
for entrance were similar to college graduation requirements of 
fifty y'.;ars earlier <Bnjbaeher& Rudy), Many colleges allowed 
students to matricuJate at age fourteen. 

The division between secondary schools and colleges has 
no! been ctear> and articulation has been m a constant state of 
flux As the secondary school system improved at the end of 
the nineteenth century and the beginning of the twentieth 
centuryt content duplication became a problem. 

Due to the overlap problem which had developed^ educa- 
tional leaders recommended various approaches to modify the 
baccalaureate program, in 1888* a! a meeting of the National 
Education Association* President Bliot of Harvard suggested 
that economizing the time to complete formal cducaiion should 
be considered. He asked if the length of time could be shortened 
and if the program could be ennched. Later* Bliot proposed 
that the four-year baccalaureate be reduced to tSuee (Bnibacher 
Sc Rudy), By I906t when the baccalaureate program reached 
its peak* 41 percent of Harvard graduating class received 
their baccalaureate degrees in ih,x5e years (Bersi* I975)h William 
Rainey Harper suggested that tl^c eighth grade through sopho> 
more year be accomplished in six years by the average and five 
years by the brilltaut (Bmbacher & Rudy^ Other educational 
leaders wanted to make adjustments to college courses them- 
selves, AiUiough repeated attempts were made through the 
fii5t decade of the twentieth century to economize the time to 
complete requirements leading to the baccalaureate degree^ the 
proposals were not widely accepted by academia. 

Other than the eontin jing expansion of the public junior 
college system and the adoption of the Carnegie uaiti through 
1950* only limited attempts were made to shorten the time to 
complete the baccalaureate degree requirements. In 1953, the 
Advanced Placement Program was developed. After Russia's 
Sputnik, a survey of manpower resources in the United Stales 
revealed that less than 50 percent of the students who graduated 
in the upper quarter of their high school class received bac- 
calaureate degrees (Bmbacher^ Rudy), Therefore* the need to 
increase the proportion of acadc ^ically capable students rc' 
eeiving the baccalaureate degree ::ame essentiaL The Ad* 
vanced Placement Prpgram served ^s a tool to facilitate the 
aeeornpltshment ot ihis national n^d. It not only expedited the 
transition from hi^h school to college but abo fostered the 
upgrading of high school Curricula, The eunent interest was 
precipitated by the rapid growth of higher education during the 
*6Qs and the financial constraints of the early '7Qs, 

A report published in October 1*373 by tlie Amenean 
Association of State Colleges and Universities cntttled Restruc- 
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luring the Baccalaureate: A Focus on Timc-Sliortened Degree 
PfOgrams in the United States revealed that 243 institutions 
A^ere tmplementing some forni of time-shonened educational 
activity on their campus. Of these programs, 73 institutions 
were either proposing, or were operating^ programs which 
offered a major modification in the traditional four-year bae- 
calaurcatc degree. A vast majority of the programs attempted 
to shorten the bacealaureaie degree by eliminating the traditional 
general education requirements or replacing them with a modi- 
fted program. However, only four institutions— Bel larmine 
College in Kentucky. Rorida Technological University, Saint 
Francis College in Maine, and the University of South Alabama 
— awarded college credit on the basis of high school course 
achievement 

Florida Technological University Program 

The Florida Technological University Time^horterted 
Degree Ptogram addressed the thesis that for the advanced stu- 
dent there is a needless duplication of effort among general 
education requirements of the university and closely related hig)i 
school courses. During 1973^ the program was limited to 108 
ft rst*ti me -in -co I lege students who had a Florida Twelfth Grade 
Test score of400 or higher <80th percentile or higher) and who 
had an academic grade (Toint average of 3.0 or higher. Students 
were interviewed by an acadernic counsetor to identify those 
courses for which university credit would be awarded. Credit 
was awarded for selected high school courses in which grades 
of 3 or higher had been earned. For examplci if a student 
completed four semesters of English composition during his or 
her three years of high school with a final semester average of 
B or higher, the student would receive four quarter credit hours 
in baste Englbh composition at the university. Table I pro- 
vides a list of Ihe courses for nhich credit was awarded and 
shows the number ofstudents who received credit in each aiea. 

Population^ The population for this evaluation consisted 
of t08 time-±>hortened degree participants from the 1973 nes* 
entering freshman class and 86 students selected as 4 i^ontrot 
^roup from the 1972 ne»-entcring freshman tl^fos. Although 
the time -shortened degree group and control grvup were not 
matt^hed groups, the> s^erc similar Jn both ^vadcmiv potential 
ar d intended college major The two gruups had similar hjgh 
school academic records. Rorida Twelfth Gr^de scores, and 
initial discipline choice. The control group did not receive 
advanced placement since advanced placement used onljr 
minimally during 1972 and 1973. 

Methodologyp The tesearch ocsign contrasted the de 
vclopment of the time shortened decree group i^ith a control 
group s^hich had been selected from the previous new tntcnng 
fre^lvn^n vlass. The Undergraduate Program Area Test, Under 
graduate Aptitude Test, and the WalMW -Clatter Critical Thmkjng 
fnvcntoi^ ^ert used to cumpatc the intcilcctum development 
of the two groups. The academic achievement an4l>i^is 
completed by cumpanng the overall college grtufc point jver^ge 
ar^d the retention profiles b> enrollment c«]tegor> for ihc ti^o 
groups, fn addiiion. an anal>MS s«4> completed of the grades 
awarded during the first two quarters to time shortened degree 
students in courses for which prcrctjuisite credit had been 
awarded on the basis of high school achievement. 

A follow up survey was compfcted in Februao 1977 
which was designed to assess the level of prc^ram satisfaction 
and pcrcejved intellectual development by gruup^ 

Presentation and Analysts of Data 

The eompartson of the achievement records «md rcti^ntion 
ration revealed that the time-slHi;1cncd degree griHi|> v^a.s at 
leOAt ^ucccysfol as the contruf griHjp. furtherniiTre* die data 
indicated th4it time .shortened degree Mudcr.ts mjintairjcd r<=l<i 



Table I 

Numbcf of Time Shortened Degree Students 
Receiving Credit, by Subject Area, 
Fall 1973 



Subject area Total 



Communication 



I3nglish 


78 


Speech 


II 


Engiiicering 




EEngincpring Graphics 


5 


Humamnes 




American history 


7J 


WoiEd history 


22 


Humanities 


21 


Languages 


64 


Mathematics 




Introductory algebra 


59 


College algebra 


24 


Trigonometry 


40 


A Italy deal geometry 


24 


Calculus I 


4 


Natural Science 




Genera] biology 


76 


General chemistry rundar.^niak 


65 


College physics 


J9 


Social Science 




AnteriCan national govemmem 


19 


General sociology 


15 



tivel> high grade point averages even though man^ v^ai^ed the 
prerequbitc requirement for advanced courses. 

InteUecttial development. The testing progr4im rEvtaleJ 
substantial differences betv^een group mcana for 4 of f'^e 6 
areas of assessment. Table 2 provides a summary of the 
measures of central tendenc> and dispersion of each test area 
by group. 

At IcuSt njne tenths of the tjme-shortencd degree group 
and upproAjmutcl> o«ie third of the control group pdrtjup4iic<i 
in the testing program. The control group members who par- 
ticipated in the testing program were representative of the 
overall control group m tcrma of a^demic potentjdiaa measured 
b> the E^nda Twelfth Grade Test ^Coleman Sl Kamrad* 1974y. 

A comparison of the gruup means for the veibal scale 
revealed a difference of 43.4 pomta. The null h^pothcMs of no 
difftrcnuc bctv^ecn the population nieuns 1^a^ rejected «]i the 
.05 level of significance. This ma> imply « in general, that 
atudcnt^ s^lio participate m the traditional general education 
piogr4im h«]ve n higher verbal aptttude M the beginning of tlitjt 
second >eat, as assessed by the undergraduate test, than do 
students s^hortxcivc advanced placerricnt and exempt a majuntj 
of the general education courses. The comparison jf the \|iian 
titalivc aptitude mean svores for the two populations did not 
reveal a statistkalt> significant difference at the .05 level of 
signiftcancc. 

The comparison of the uea mean test scopes revealed a 
difference of 71. 6 points in the humanities area, 51. 1 points in 
the natural science area, and 61.3 points in the social science 
area. The null h>potbe^ja of no difference between the ts«t> 
population me^ns was rejected at the .05 level of significanu jn 
each case. These find.ng^ ma> be mterpreted, m gcnctjl* to 
mean that students ^ho ^.omplctc the trcsdjtional firsi >e«]f of 
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Table 2 



Summaiy of Undergraduate Prograjn Test and Watson^Glascr 
Invcntoiy Results, Fall 1973 



Test area 


Time-shortened degree ^up 


Control group 
















N 




Standard 


N 


Mean 


Standard 








dcvtaiton 






deviation 


Undeii^raduaie program aptitude 
Veiba!* 














106 




85 8 


30 


525.4 


95,2 


Quantiiative 


106 


573,9 


92,2 


30 


590.2 


80.1 


Undei graduate program atca 














Humanities* 


m 


447.2 


64,6 


26 


5IS.8 


73. i 


Natural science* 


m 


548.5 


78.2 


26 


599,6 


90.4 


SociaJ scEenct^ 


m 


442 5 


71,1 


26 


503.8 


101. 1 
















Critical ihmkiDg 


n 


77.9 


8,5 


21 


79.5 


7,6 



*Thcre was a ^j^iic^ly signific^l difTcitnc^ between ihc ^evel or ^li>cv«mef)t for (he iwo groups jt the 05 level of sigufic^e 



eoUege have a broader scope of knowledge in the humanities* 
natural sciences, and social sciences than students who receive 
advanced place':;C'*t and waive these requirements. Siuce aca- 
demically capable students at the university enroll directly in 
courses offered for majors rather than the traditional general 
education courses, the difference between the natural science 
group means may not be attributable to participation in the 
traditional general education curriculum, 

A comparison of the group mean scores for the Watson- 
Glaser Critical Thinking Inventory revealed a difference of 1-6 
points This diflfetence did not represent astatisttcally signiftcant 
difference at the .05 level of signincauce. One of two conjec- 



tures may be drawn ^m thcfe findings. Either cntical thinking 
ts not being taught in university general education courses or 
crttical th..)king is being taught, but the ability to apply these 
competencies does not develop until the student has had the 
opportunity to apply the techni<iues m the last three years of 
the baccalaureate curriculum. 

Academic achievement. The three basic areas addressed 
by this scctiou include overall grade point average analysis, 
retention analysis, and impact of waiving prerequisites. Table 
3 provides a summary of the dtstnbutton of the enrollment of 
time-shortened am) control group students by group, enroll- 
ment category, and overall grade pomt ititervaL The data 



Tabic 3 

Distribution of Time- Shortened D<^ree and Control Group Students 
by Enrollment and Grade Poitit Average Category 



Group and . ^ 
en:ollment category 


U50-r99 


2.0(^2.49 


2,50-2.99 


3.00^3.49 


3.50-3.99 


4.00 


Enrollment 
total 


Timc*Shorl€ned degree 
Eni^lkd 




3 


17 


17 


7 




44 


Not enrolled 
hr* 


1 


1 


3 




I 




7 


£90 hfs and 
<I35 hre 


3 


1 


7 


3 


1 




15 


£135 hrs 










E 




2 


GrnduAiod 






6 


l6 


15 


3 


40 


Orowp lotal 


4 


5 


33 


38 


25 


3 


tOfi 


ContToi ftroup 
^.*ant>!led 


I 


3 


4 




5 




13 


Noi enrolled 

hr% 1 1 


\ 


9 


4 


3 


5 




24 


£90 hrs and 
<J35hrs 






4 




1 




6 


£135 hfs 














0 


Graduated 




4 


5 


19 


15 




43 


GnHip toial 1 1 


2 


16 


17 


23 


26 


0 


86 



\\\\lAl^'n passing 
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r^vedleO ihdl 61 percent ol time-shortenej Jegrce group 
and 57 percent of the eontrol group attained a B average or 
above. The null hypothesis of independence using 4 Chj- 
squai^ aitdlysjs for group tuUJs Vtdh not rejected at the .05 kvcl 
signifitance. This would imply that grade point average <n 
nut dependent on group. The null hypothesis of independence 
on the enrollment eaiegory totals was rejoeted at the .05 level 
of stgnifieance. These data revealed that enrollment eategoiy 
was dependent on group. A detailed analysis or these data 
revealed that a greater portion o\ the eontrol group had gradu- 
ated, a greater proportion o\ the eontrol group dropped out 
prior to eomplettng 90 quarter hourst and a greater proportion 
of the time -shortened degree group were stilt enrolled. The 
data seems to iitdieate thai panieipation in the Time-Shortened 
Degree Program does not aeeelerate students by one complete 
year. However, participation m the Timers hortened Degree 
Program may decrease student attrition. The percentage of 
students who either Iransferred or dropped was only 22.2 
percent for the timc^shortened degree group compared to M.9 
percent for the control group. 

Table 4 provides a comparison of the overall grade point 
average and standard deviation by enrollment category for the 
two groups. These data revealed that the overall grade point 
average was the highest for each graduate subgroup. A com- 
parison of the group means revealed that the overall average 
for the time -shortened degree group was higher than the con* 
trol group mean in each category 

A statistical analysis in which the null hypothesis of no 
diffcreiKc between population grade point averages by category 
was completed. In each case the null hypothesis of no dif^ 
ference was not le^jccted at the .05 level of significance. The^e 
findings would indicate thai participation in thcTiuie-Shonencd 
Degree Pto^^ does not affect one's overall grade point 
average. 

T?blc 4 

Average Grade Point Avr;ragc and Stand^^rd Deviation 
by Gfouf and Category 





Time -shortened 


Control 


Category 


degree 


group 


group 




y 




7 




Graduate 


3 430 




3 284 


453 


Enrol ted 


.1076 


434 


2 96^ 


669 


Dfojroed 


2 793 


576 


2 765 


779 



Table 5 provides a summary of the grades received by the 
time-fthortened degn^e students m mom advanced cotirscsdunng 
their first two terras of attendance, after being awarded credit 
for the prere<|utstte course These data indicate that more than 
54 percent of the students received A's^ about 38 percent 
received B*s» and only 6 percent received less than a C, Of tlie 
13 grades which were below C, 9 were in mathcmattcs. The<;c 
data seem to indicate that the timc*shonened degree porXKripants 
were able todd satisfactory work in the more advanced courses 
aflcf having received credit based on high school achievement 
in the prerequisite course(s). 

Survey findings^ The follo>^-up iurvc> revealed. *n gen- 
ctd\* tliat both gniups made ton>idcrablc progress tuward 
meeting their educational and prufoMon^l guals Ltke\MN4:.» 
parljtipatjon in the Timc-Shurtencd Degree IVugrani did 'Ktt 
appear to hinder thi>sc students who applied to gra^<^te ^nd 
pn.)fc^^u>nal ^ithooLv Sixi>'i^>nc percent ot the titnc shorter^cd 



degree group and 27 percent of the ^.ontrol ^roup rc:>pondtd to 
the survey. 

Table 6 provides a summary of the highc^t degree expe^- 
tat^n b> ^roup The null hypothesis of independence^ u:>ing <i 
Chi-s^aare analysis, was not rejevted at the .05 level of Mgnifi 
tante. These findint^^ indicate that highc:>t decree expectation 
is independent of group. 

Table 5 

Number of Grade> Received in Advanced Courses 
for A^hich Prerequisite Credit Was Waived, 
by Course Area* 
Fall 1972 and Winter 1973 



Achtevemcnt tn more advanced 



Highest level 




or related 


courses 




awarded 


A 


B 


C 


D 


F W 


HumaiucicS & Hne arts 












£nj,hsh 101-103 


3 


6 








History (Amcncan & 












Western Civihzatton) 


2 


2 


2 






Speech 101 


0 


4 








Langufige 100 


4 


J 


4 






Natural science 












Math 104 


10 


9 


7 






Math 106 


5 


2 


4 




1 C 


Math IH 


22 


14 


10 






f^ath2il 


7 


12 


5 






Maih 321 


2 


3 








Bioiogy lOO-lOJ 


J 


9 


4 


2 




Chemistry 101-2-MI 


8 


11 


7 


2 




Social seiencc 












Sociology 201 


2 


I 








Total 


72 


80 


46 


9 


4 



^Ocsi^nati;^ courts rc[icate4] and gradcv 3^hl^dc4] 



Table 6 

Highest Degree Expectation 
by Group 



Dcgrt;c level 


Time -shores tied 
degree 


Control 




Number Percent 


Number Pcrc>:nt 


Baccaljufe;itc 


\9 


29 


5 21 


Masters 




50 


12 50 


Professional 


6 




2 % 


D<Ktoratc 




12 


5 21 



Table 7 provides a summary of the number of graduarc or 
profcfisional school apphcation> filed and the number of ac 
ccplanccs by group. ThcMi data revealed that although very 
few "ttutknt^ had applied tc graduate 01 pn.>fcvMonat svhiioU. 
they v\fQTc very >uw.,.~'sful in i^!^lainjng aicepianics. When the 
time .-vhoricnc^l degree Mudcrit> were asked if participation in 
the program afrei^ted their acceptance status.* thrcc studcnt.s 
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reported that it fr^vor^bl) afTe^tcJ iheir ^tatu±>^ the ncmaimkr 
rcporieJ thnt it hnJ no impact 

Table 7 

Number Graduate School Apphcatioiu 
ami AcccptarKes by Group 





Number of 


Number of 


Group 


appljcntions nicJ 


acceptances 




I 2 3 


1 2 ^ 


TiTie- shortened degree 


to 5 6 


12 4 5 


Control 


6 1 3 


6 2 2 



TabJc 8 proviOcs a nummary \yi hi»w the participants per- 
ceived their expcncncc at Rofida Technological University tn 
several areas of academic or social development. These data 
revealed that a vast majority of students from both groups 
perceived their experience at the univenity as an important 
contribution to their intellectual or cultural growth development. 
However, a greaKr percentage of time -shortened degree stu- 
dents indicated that their cxperternre contributed only a small 
amount. A null hypothesis of independence using the Chi- 
square analysis was tested for each area after the little progress 
and moderate progress columns were combined. The quantita* 
tive area null hypodicsis was rejected at the .05 level of signifi- 
cance. This would imply that the control group perceived their 
university experience as contributing more toward the develop- 
ment of this competency. The remaining null hypotheses were 
not rejected at the 05 level of significar. e. When the time- 
shortened degn^ participants were asked direct que'^'.fons about 



Table 8 

Summary of Program Contribution in 
Selected ArtaSt by Group 





Tim,>shorlencd degree group 


Conuol group 




Little 


Moderate 


Much 


Very 


Little 


Moderate 


Much 


Very 


Item 


progress 


progress 


progress 


much 


progress 


progress 


progress 


much 










progress 








progress 


Intel tcctuat growth Y(>ur 


















ahthiy to understand and use 


2 




36 


15 


0 


7 


t4 




coiKepts and principles from 


















M;vcral bmad areas of Icamrng 


















Socmt growth. Vour under- 


















standing of other people and 




25 


19 


t4 




6 


6 


10 


ihcir views ywir esspencnce 


















in rebtii^ to others 


















AeMhctic and cultural growth. 


















Your awareness a^'d appieci* 


















atton of titeraiure. mtisic. an* 


IS 


26 


tt 


s 




8 


to 


3 


and drama of your own 


















culture and ol others 


















Reasoning ability Rccog- 


















ni/ing assumptions* making 


t 


27 




14 


0 


5 


14 




togtcal inferences, and reaching 


















conclusions 


















CnncaL thinking Abttily to 


















withheld judgment, raise 


4 


24 




14 


1 


4 


12 


7 


questions, and examine con- 


















trary Views 


















Quantitative thinking Undcr^ 


















standing concepts of proba- 






t4 


M 


I 


4 


H 


4 


bility, ppoponton, marf;inof 


















error * 


















Writing and spcal.ing Clear. 


















correcu effective 


9 




19 




1 


10 


9 




communication 



















'There wu a ^latistts ally si^nifi^ani Uiffcncnce J< (h« OS jc>«| (J ^i^Pificancc 



81 



TJ MB SHORTENED DtiGREE PROGRAM 



ihc v^itlt^ of ihe progranii ihc^f o\^rvthQ]nua^\^ rcpurtcU thai u 
^ds an oulsUinding progritm itnd did nvjl hindci their dc>cEop- 
mcnL Likc^^ise* Ihe) reported ihcy mouIJ rci.ommt:nJ h tu anj 
Muclent who had a similar background. 

Conclusions 

The findings of the ^tud^ mdiLaEc that bi>i\i the time 
il^Mienuj degree onU Lontrtil groups w^re suLu;^rul m avhitving 
their Ukctdeinjk gOitU. Mtjn ^curcs of the conuul group on the 
Undergrddii^Ee Prijgrani Test ^vere greater ihitn M,ores of the 
time shortened degree group in the verbal aptuude and arva tests 
al the beginning of ihe program Nvj JtfTcreiKe tva^ <ib^med in 
cither the quantitarivt aptitude ^tmn or the Watwn-GJasi^r 
Cniical Thinking Inventory means fi>r the two populations. 
Although the graduatigin rate ^as higher for the control group 
a[ the end of three years, the overall attrition rate for the time* 



shortent^d degree group wai lower. The tjme ^hortencti degree 
group ver> ^UL^c^sful in ^our^s for whii.h prerequisite 
credit had been awarded and attainetl at least as high anuver^tt 
grade potnt as the control group. Both groups perceived the 
university experience as making a substantial contribution to 
their overall intellectual and social development. However, a 
larger proportion of iJte control group expressed reservations 
about tiie V'ltlue of their Ui,uersit> experience in contributing iu 
the intellectual and cultuidi development. Direvt program 
evaliiation questions evidenced nearl> complete satisfaction 
\vith the Time-Shortened Degree Program, 

StiiLe ^ majonty of the time- shortened degree group did 
not graduate m the thrte-year penod* additional research witt 
ha^e to be completed before condu^i^e evidence can be pro- 
vided about the overall (Effectiveness of the Time -Shortened^ 
Degree Prograin, 
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The explosive and dramatic growth which has charactenzed 
the development of (he Brazilian economy since the mi.. [%0s 
has been labelled '^^w^^d^ Yet, even those persons who arc 
most laudatory of such growth arc also aware of the problems and 
obstacles which have accompanied this boom. Brazilian higher 
education — indeedi the entire educational system — has not 
e^apcd some of the probJems resulting from this growth. Inade^ 
quale physical facilities* too few qualified faculty, arid under- 
developed libraries aic some of the problems thai plague the 
orderly growth and development ofBrazilian education. Inh^er 
education, especially* we ^an say with accuracy that most of 
these difTicuhies have resulted from a scarcity of accurate 
statistical data which. In turn, makes educatiot\al planning 
difficult to accomplish. 

A recent pubi^:atlan by the Carlos Chagas Foundation of 
Sao Paulo states: 

During the last decade, educational planning has had a 
strong impact on the Brazilian educattOhrJ system . . . 
The Ministry of Education (Ministerio da Educacao e 
Cuhura, 1974) points out that tn the early stages of 
development of educational plannlngiOne of the greatest 
difTiculties was the scarcity of information about the 
educational system The same publication charactenzcs 
the present stage by two main efforts: (a) to solvj the 
most crucial problems; and (b) to develop a better in- 
formation system. It is explicitly recognized that much 
rescarchand evaluation isneeded to support the continuing 
development of educational plans, (Bessa* I976i p,17) 
Before delving further into the origins and details of Ihis 
problem, we should first provide some background about the 
Brazilian system of higher education. 

Background 

The early 1960s signalled the end of a period of long 
pedagogical debate resulting in the approval of the Law of 
Directives and Bases of National Education. The adoption of 
these directives ushered tn a new period of university reform. 
Bom out of a compromise between two opposing philosophies, 
the Law of Directives and Bases of Education was, in efrt:t, 
a synthesis of antinomies. It was this reform which made 
possible the development of the coniprchensive integrated 
university, the movement toward which comprised three 
distinct phases^ (a) implenrtcntationof the University of Brasilia* 
(b) the university reform movement, and (c) implementation of 
the reform on a general ^ale. 

While the reform was well rccetvedi it had no immediate 
impact on the expansion of higher educadon. It was the student 
unrest and public pressure for expansion of higher education 
that pushed the government tocreate a taskforce toexpcdite the 
university reform. 

The work of the task force for the reform of the university 
constituted the second phase of the reform movement. The 
basic philosophy of this working group can be summarized as 
follows university reform must, in the opinion of the workjng 



group, fulfill its primary function of accepting the role as a pre* 
investment in the development effort (Abu*Merhy^ 1971). 

Following is a brief description of the new structure of 
Brazilian higher education. According to a 1974 report of the 
Ministry of Education and Culture the guidir^ principles of the 
present untverstty reform are the following: 

L The principle of no duphcattonof means for identical 
or equivalent ends in order to permit full utihzation of available 
resources 

2. Tlie principle of structural and functional integration of 
research and teaching wuhtn the university 

3. The adoption of the departmental system 

4. The concentration of basic, scientifiCt and humanistic 
studies in an integrated system of umts (centers or facilities) for 
the service of the whole university 

5. The organization of ^ ^rst cycle of basic studies com- 
mon to a!l courses or groups of related courses, 

6. Tlie creation of a superstructure of graduate courses 
(Sucupira). 

The real and dramatic expansion of Brazihan higher educa- 
tion started tn the 1960St when the LawofDirecttvusand Bases 
of Education permitted the creation of private insbtutions of 
higher education. Asaiesult^ m 1973 there were 797 insntut ions ^ 
of which 57 were universitieSi 3 were federattons of schools, 
and 712 were ""isolated schools." By type of control, these 
institutions were distributed as shown in Table 1. 

Table I 

Number of Institutions of Higher Education m Brazili 1973 





Federal 


Stale 


MunjCipal 


PnvaJe 


Total 


Universities 


29 


7 




20 


57 


Federatjons 












of schools 


1 






2 




isolated 












schooH 


16 


74 


75 


547 


712 


Extensions 


25 








25 


Total 


71 


SI 


76 


569 


797 



Note From *"EImcrjj|ine Simclurc\ ol Ht^hcr Education and ihc 
Couimunit) College CuntCpi Implii-ilMjns t<jr Brazilian Higher 
Exiucatjon/' an i npuhli:>hcd doi^ttsiraj dt\M:njttv>n by J C Dos 
Santo^i Friho, I nivcrsiiy of Souiltt:m Cahfomta. t974 U\cd 
by pcnnissmn 



Another result of the reform has been a dramatic shift in 
emphasis from elitjst to mass higher education in Brazil. 

As Jose Camtio Dos Santos (1974) points out: 
While in 1 963 only 1 3 out of a thousand students who 
entered the school System registered in higher education, 
in 1973 there were 63 out a thousand entering higher 
eduacition. While, in 1965 the index of .students in 
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higher eduction for a populaUon of a hundred thousand 
people was 2 percent, in 1973 thai m<kx ro^ie to 7 
percent. <p, 14S) 
The magnitude of ihisexpan^iLon boti reahzed vvhcnune 

iiludte^ the enrollment grov^th ^hi^h ha;^ ot^curred dunrjg the 

la^t three decades. 

Table 2 

CroiAth of Student Enrollment in Brazil from 1940 to 1974 



Year 


Student enrollment 


1940 


2J»000 


1950 


44,000 


1960 


93,000 


1970 


425,000 


1973 


836.000 


t974 


l>0]g>000 (estimated) 



It is not onl) this rapid gro^ th tn enrollment that ha^ made 
plannlrig difficult There is another, more important, reason, 
poor methods of data collecttrig Educational data collected 
and anal>2ed primaril> so that tt can be ui^d to improve the 
processes of administrationt planning, and d^^ision making 
whicht in turn* assist in the improvement of education. 

The lack of proper methods for data collection in Brazil 
results, in targe pan. from the attitudes of educational ^jdniinis- 
trators (^^'ho are not customed to having timel> and pertinent 
information available to serve them and who generall> do not 
think in terms of the role that such information could ptay in 
their dee Is tons). 

Obviousl>, the relationship between the gathering and 
development of educational information and its in planning 
and decision making is one which can be resolvtU onl> m part 
by improvements in the information s>stem itself. Operation of 
the Brazilian education s>stem needs to be considered a 
whole. Including all levels and t^pes of education* both formal 
and informal methods of delivery, and both pubitt and private 
sectors Also* the inputs to,and production from, the^ areas 
need then to be related to the economic and social ncedi> for 
training and for other education based char» .ten^tjcs of the 
population. WeU-org^nized and reliable inforniaiion can serve 
to im[ 'ove and strengthen education, but not without full use of 
that information in the management of the system. The planned 
development of Servico de Estatistica ^e Educacoo e Cultura 
into a national education information system at ihiOi a hopf;ful 
development. However, to be effective* it must be linked vtith 
research, economic planning* and ^ more uoordinated uperalton 
of the entire education system. 

The following brief account of one federal university's 
efforts; to develop and implement master degree programs is 
mtended to illustrate some of the obstacles that :>tand m the vv^jy 
of proper planning of such programs 

Case study 

In May of 1974, the School of Education of the Federal 
University of Parana began planning and dcvelopir^ its first 
graduate program Major rcspor^ibility forthistask ^V4is assigned 
to an elderly professor who held the degree Liire Do^ente He 
was asusted by others of like training and expericncCi none of 
whom had master'sor doctor's degrees or taught graduate level 
coiirsci. 

Initial efforts toward curriculum development ^verc hap 
hazard Advice of available curriculum spcvialisLs ^vas not 
sought^ programs or courses were not bdsed on labor market 



iiurveys or job analyses which would indicate the type of 
graduate desired nor was adequate attentiongivento die NationaJ 
Plan for Graduate Education. Instead* the two curricula de- 
veloped were based on the personal experiences of certain 
individualsi the courses (disciplines) that <,ould be offered b> 
presents local faculty, and the heavy interest placed at that time* 
throughout Brazil on planning. The two areas of the graduate 
program selected were (a) teachir^g methodology and (b) eduea- 
^ tional planning. 

The lack of underuanding of what graduate education 
involves and the lack of sufficient academic and technical 
planning assistance in preparing the graduate program were 
quickly noted t primarily by tlie younger professors (with master 
and doctoral degrees from the USA and Europe) who were 
called In later to serve as assistants to the Livre Oocenter. 
Several probable obstacles to implementing the graduate pro- 
gram and obtaining accreditation from the Federal Council of 
Education were cited by the younger professors. Most impoitant 
among them were (a) an inadequate library collection^ <b) an 
itisufhcienlt number of Ph.D/s and (e) the existence of similar 
programs in several other Brazilian universities. 

Even though these implied suggestions for improvement 
went unheeded* consultation was sought in Apnl of 1975 from 
appiupriate fecleral agenctcs for the formal request for atciedita* 
tion. At that time* tt was once again pointed out that several other 
federal universities were offering similar programs* that the 
present quality of the faculty needed strengthemngt that the 
librao ^as insufficiently specializedt with too few holdmgSt 
and that certain support conditions ^ei{iiipmeni, fnavilitJes* and 
i>ecretanal assistance) needed improving, n was suggested that 
the School of Education reconsider its plans. In the meantimei 
classes continued to be held. 

Jn May of 1976* federal agencies offered to furnish sub- 
stantial flinch for the improvement of the above-notod dcfictencics 
if the School of Education were willmg to develop a major in 
' curriculum'* for which there ^vas great need m Brazil. The 
suggestion and offer were accepted, <*nd as a rcsuitt technical 
agreements were prepared which enabled the si^hool to obtain 
the eq^jivalcnt of approximately $75*000 (or equipmenr* ma- 
tciialst and serial publications (the monc> to be spent within 
one year), A similar amount ^vas obtained for the conuacting of 
new professors during the period of July to f>Ci,emt>er 1976. 
Additional salao fimdir^ provided for an additional five Ph.D> s> 
twi^ Livre Docente^t and two Ph.D. candidates. 

Also* during 1976* and vvith needed assistance provided 
by facuhy with foreign degrees, the graduate program i>iatutc 
was entirely reworked with the intent of strerigthcning the 
program, addirig a new prograin in curriculum and adding 
several new faculty mcmb<*is. Subsequently a nevv program- 
directing body vtas elected and a new rc,quest for program 
accreditation was prepared and submitted to appropriate officials 
for approval. 

It is expected that the new program will continue to 
function normally in 1977. The intention in 1977 tit to begin 
planning for the development of a second maj^ir area of graduate 
study in 1978-79. Hopefiillyt adequate pbnning and survey data 
will be utilized so that the programs more closely approximate 
the local and national needs. 

DEscusslon, Conclusion and Recommendations 

Rcccntpa^tand present efforts by the Brazilian Ministry of 
Education and Culture and the related semi -autonomous) irk>tiiu- 
tionii h*ivc provided an ever more centralized viewpoint of 
ncedj; and coordinated planning efforts; through whieh it is 
expected that education can maximize its contribution to natuinal 
development. During the past twoot three years, federal funds 
for education have increased rapidly* keeping pace with the 
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govemmcnt'sbclief tn the role of eclucaljon innational develop- 
meni In fact, jmong all mjnistnes. ihc budget for the Ministry 
ol HduCfition and Cuilure tntrc«)scd the most -doublin^j from 
197610 1977. 

However* Ihe fcderaL state* and pnvaic universilies.* b> 
and large* still continue to develop ne^^ graduate pr^^rams 
largely on the basis of individual professors' inierc^t^* even 
though man) jf them lack ihc abitities and understandmg of 
what gmduate education is all abouL 

Such actions arc in violation of one of ihe dtreciivesoflhc 
Nationcil Plan for Graduate Education, which emphasizes ihe 
need for a coordinated expansion of graduate education pro- 
grams and which states that ihe expansion of Ihc s>siem noi be 
prejudiced by personal or instjlutional initiatives thai do not 
eoineidc with naiional prlorilies. 

Inilially* the Ministry of Education made no concerted 
altcnipi 10 compel universilies lo follow mi nisuy -level planning. 
Consequently, individual profcssom and institutions eonljnucd 
t'> create or expand programs having inadequate program struc- 
ture (hbrunes.* laboraioncs. equipmc.nl. staff support* etc J and 
msulficient numbers of qualified professors The NaUonal 
Counc il for Graduate Education, therefore, passed a resolution 
requiring that financiiig of new programs or the expansion of 
existing programs can only follow preliminary approval by ore 
of the council's technical coordinating j^roups Hence, to obtain 
federal financing todd> forgraduateedULation, a series of forms 
justifying the creation or expansion of ^ program, guaranteeing 
the eontinuance of the program for at least three years, and 
setting forth a program for faculty upgrading mu^t be submitted 
at least 180 days prior to the projected date for initiating 
graduate program activities. 

There continues to be a lack of adequate conimu meat ion 
between the federal coordinating agencies and the universitiei> 
and the professors involved 'n the programs Moreover* much 
of what is Communicated goes unheeded Jt the lower levels and 
underscores the need for more effective two-way tommun nation. 

Amulier interesting point to sonsider is fmanLing In the 
past, plans for program development were made and funds 
prorniH'd But*inman> cases, the financing did not materialize 
Therefore, in the earl> phase of program development, there 
was a general pessimism about rcs'eiving any fund^i and, there- 
fore, little desire or interest in planmng for them. As a consC- 



qutnte of the present availabxlt) of govcminent funds and 
present understanding or ptygram planning and cxevutxun, there 
IS now the odd circumstance oi having* or being able to have, 
flindsand not knowing how to use them well. 

In an attempt to clarify and begin remedying some of the 
major problems vthif^h have beset graduate program develop- 
ment b> discussing mutual development p^>blcms* a nation- 
A ide seminar of graduate school deans and mimsti^ personnel 
was held m December of 1976, The implementation of the 
Institutional Plan for Faculty Training was tinothei positive step 
taken in 1976 towaru upgrading and eompletmg graduate 
program faculties which, in turn.* have provided a muuh stronger 
basts for supporting research on the graduate levels 

If graduate-level prpgrams aie to grow and develop properly* 
pl^nnmg must first be improved and regulari^d 

The authors believe the following four major suggestions 
would bnng about the nc-cessai> improvement. 

I Some formal, regular means of cx^mmunicationtnews- 
letters* meetings* and/or other forms of communications ougtit 
to be e stab I tshed— vertically between the ministi> and its 
related age^ictes and the universities, and honzontall) among 
the appropriate university pcrsomel — lo keep all involved in 
planning graduate programs fully informed. 

2. A series of regularly scheduled training progrunisy 
seminars, accompanied by the distribution of pertinent tcth- 
meal materials* should be offered to ixi\ those responsible lor 
planning and developing graduate programs ^vithin the Jedcra' 
universities. 

3. A ministi>'leveL or mmisti> and xts related agencies* 
technical aid service should be offered, either on a regulai oron- 
call basisn* to assist those responsible for planning individual 
graduate programs or university graduate education systems 

4. A series of regtilarly pro- rammed* vertically and hon- 
zontally focused planning sessions should be built on the above 
ihree activities. Such activities would not only provide a better 
insight into* and acceptance of.* overall and detailed planning 
but vtould promote a con:>i4nt eoordination of graduate progr^&ju 
plannirig. 

Failure to find .solutions to the problems refer^d to in this 
paper will lead to more serious difficult ids .and ^iH further 
unpcde the development of needed planning efforts 
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The purpose of this paper will be lodcsc ibe ihedcvelo"^ 
ment and use of a ciepaitnieni and program review pro 
emplo>e<Jat the University of Uuh This process was<lesigii^ 
10 identif) issues and problems of planning and nianage*nent 
as well as to 4.jnsidcr their impact on rtsouice and v^as 
m^n<fed to Produce information in a form useful to ins itutiot. J 
managers <cxecutivc officers, deans^and departircnt heads) as 
the> make resource allocation decisions. The =icti^ *ies of 
UTiiversit> planners -nd instiiutional researchers as *Ucy wp- 
pv>rted the re\iew process will be gi^'en special emphi^^is. 

Before proceeding, it seems appropriate to defmc the 
^L'^r^cept of review A review* whether program or (depart- 
ment IS a process of collecting* analyzings and integrating a 
varer> of dar elements in orier to focus attention on ^ jff^ 
V unit pcrformaiKe and polrcjes directly related to enrollment, 
pcrsonn^h fiinding* 'vork loadi andcoiirse and degree offenngs. 

I other words, a r^vtcw process provides an objective macro- 
anal>lis of departxneut or pro^^am policies and practices that 
re<]uire a close' took vtelj providing clues dS to which 
Jcpartment' Oi programs may be candidates for resource eii- 
nchment or reallocation 

The Review Process 

The plai^ning and budgeting ^rocesfes preside instan^es 
4!ierc thca\ailabilil> ofdepartment or program review informa- 
ticri can influence decision making Severn yea*^ a^* staff in 
the INversity of U tali s Academic and Financial Planning 
Off t*]at they could improve thur service to institutio lal 
anagerr by initiating a review process intended to accoiii^lish 
the following objectives: 

L Unj\crMty dccuon makers wouli be PiX>vtJcd witL 
!]tre!> planmri^ and management infonriation obtained from 
c^^ntral data soufx^es. 

2 $igr:*lcant trends in specified aie^> of university opc.^- 
tttm^ would be highlighted 

3 Attcnlton would be focused on :|>e^iric problems and 
pohc;' i^sycs- 

4 A medium for familiarizing decision m^ikers with the 
u« of management Intormation would b*^ provided. 

To achieve these objectives* i\ was ncv^ssajy to employ 
several strategies and to jr.tiate j variety o' fictions. 

A. RevJew cons^eratlons* llie decision to mitiate an 
ong ng rcntraJized review process wa.'^ p'^eccded b) ^jIsL.fb- 
lio^i of seven <]ucsttons 

1 V't*o are the primary acton; m determining the alioca^ 
tECnoi'ir „ajtjon a I resource:? 

2 V/hat forma) ard informal processes are employed to 
4imie '^X p'^nmng and rerout e allocation decision^? 

3 W^at role docs data an^ysis ptay ai department, col- 
lege. .Jid ' autionaJ planning and buc*^cti.ig devisions? 

4 What amount of staft effort is devoted to the pr^para- 
tton of planning and managet^ni iinfonnaiion? 

^ ^sr pirjining and hudgci'n^ data available v^hcn needed 
bj decision makers? 

6 Do f fanning and budgeting data portray ixt\\6i in such 
areas as enrollmer' course and dtgrct offerings, personneU 
work )oad^« anc* ling'> 



7. Are planning and budgeting data analyzed and provided 
to decision makers with commentary? 

Answers lO 'hes' <]uestions helped (o dr termine whether 
an ongoing il^parLiient or program re^ lew piocess was needed. 
The answers also provided clues as to how ^uch a process 
cotild effectively improve managerial decision making. 

Data ccnslderattonsi^ The rc lew process was de- 
signed to focus atten^on on ^mit pe.formance and policies 
through the display of manai^biuent information. Thr prepara* 
tion of management inforrrAiion involved defining, coi^ecimgi 
intenelatingi evaluating* analyzing, and mterpretmg data to 
assist decision makers in Jdressing the issues and problems of 
planning, organizing* jx* * controlling. The need to take e.!ch 
of these items into corsi^l^ration dtmng the process of prepanng 
n^view information caused numerous problems and cnallenges 
for t>ie academic and financial planning staff. For example* 
data elements considered as a{ vriate desen, rs resided in 
a variety of di*ta bases which developed to satisfy the 
operational day-to-day needs of specific <tdminrstrative 'inits. 
Since the stewardship function of administrators varied signifi- 
cantly from the planning^ organizing, and controlling functions 
performed by managers* prepa-^^rs of review data had to identify 
ti, veaknesses and rdiosyricrasies of operational data before 
sucn data could be processed. Below ^re several examples of 
issues and <]uestions staff planners encountered when con- 
sidering data elements for review purposes. 

t . Student credit hour data ean be reported in a variety of 
ways* e.g., by c^ur^ level, by student leveU and by a com- 
bination of the twii. Which way is most meaningful? 

Full-tin^c ^uivalent student and faculty calculations 
can be derived in n'^merous ways Wh^^* criteria should be 
employe'i? Can this criteria applied uniformly within the 
institution? 

3. The accuracy of student and course data dependent 
on the admissions and registration 'ocesses and systems. 
Where do the holes exist in these sysv^^ms? What problems aiv 
created through automation^f these reports? 

4« Financial data Lafr be reported using actual c^pt^r^ititrcs 
or budgeted amounts. Which reporting method will provide 
timely* yet comparable, data? 

5. Is it po^sibk to obtain an accurate cQMnt of regular and 
part-time students and faculty? 

6, Can the iiistitution identify which graduate assistant*; 
and fellows actually have cour^-rclated ^sponsibtliiies and 
which do not? 

7 When should the snap^ltot be taken for each type of 
data? What reconciling problems will be i,reated these 
time frames vary? 

8. Is it possible to implement a data crosswalk ttctween 
the institution*sorganizational structure and Higher Education 
General Information Survey (HEGIS) disciplines? 

The academic and fir ^al planning staff were also con- 
cerned *hal review ^^formation mirrot organizational <jtd pro- 
gram units os arly us po^siJjle. It is especially important to 
check thi^^ ^n computers are ptogrnmmed to perform much 
of the daU ' iCgratton and manipulaiion, ThtK pomt prompted 
conddefdjon for the evaluaiion of review information prior to 
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its use by decision makers By employng computer technofog> 
and sottware packages to generate nunagemcnt inform^tioi . 
institutional personnel have increased their ability to prcxki^e 
an overabundance of data However^ the uiility of such data is 
questionable unless its accuracy is verified Therefore, preparers 
of review data must define their expectations regarding data 
ae^^uracy and UtHity The academic ^nd financial planning sUVl 
rvspondcd by posing questions about data validity and reliability 
to those who maintained each data system that supported die 
review process In addition* these admmistrators were asked to 
''signoff* On data derived froin their data bases before it was 
distribuied t.t academic units. 

A final consideration regardirig data preparation concerned 
the f^t that few academic deans and departmenr heads have 
th'^ time or desir to review voluntes of data. Therefore* data 
synthesis and ii t^rpretation become indispensable elements in 
the review process The planning staff in the Academic and 
Financial Planning OHtce saw their role and task as one of 
trans latmg numbers Into infonnation that ac4demic administra- 
tors could 

With these considerations in mind* (he data elements and 
their u$es« (as listed m Table I) were those employed by the 
academic and fmaneia" .tlannirg staff for inclusion as the 
primary department and program review data. 



C, Dat^ display* After data elements were select ;d, an 
appropriate display fonnat wa^ designed to aid m ihe ** jollee- 
tlon, integration* anj analyses. The major sot* ^s of data 
included, registrar's rtporfs enrollment, credit hours, and 
degrees conferred* budget and financial reports* instruciional 
staff atid salary summanes of the Amenean A>soc]ation of 
University Professors 4AAUP)* inMntciional wol^ load ^jnd 
other activity data. MoM of the compilation work .nvolved 
trans% of data elements from si4nd:Md reports (some com* 
puten .d) and do^^ments to a four-page summary format 
designed for the project (sve figures I and 2) These data 
formats served to display review ^ta for the three groups of 
institutional decision makers, executive offtoers* deans* and 
department heads. 

D. Data analyses. In addition (o supplyi:^ <kcr ion maker: 
with trend data« plannmg staff also perfcmed analyses which 
centered on such topics as course ai*d 5e;tion proliferation* 
faculty activity and instructional produetivj'v, the replacement 
of teaohjng assistants ^^ith regular faculty to improve under^ 
graduate education* the magnitude of instn^eiional service to 
departmental iTmui' versus other university majors* and class 
;ize analyses. 

The ^ '^'imnj4iitest mcludi^ vritten atiatyse.^* helped to 
highlight jrgnificant trends and issues i^fc^neeni to exeeuiive 



Table 1 

fk'partment and Program Review 
Data Eteii ;nts <.nd Their Um>% 



Dai a e lenient 



Bu^t-^^'tcd FVf. I^culiy 



Uses 

Mcdiurc of ioslfucnonal service by ^;ou^^^ level 
Source foi PTE shidcni enroilnienT 
l«,ifXKnonal waik producltViiy raiio 
LnsiruciK^nal woik loud niatn\ 
Enrotiineni projcsiiions 
Siu<fem/fi)Culty iHiio^ 

Measure of btidg^^twl salary support 
Insiructionat loud productivity rat*o 
Average ^atary mformalitifi 
SiuJeni/ faculty raltos 



(regular only^ 

Rudgcicd TU. teaching 
as as; ants 



Budjiictcd salines 
(rujuJlar facuii> & FA/TP* 

Total (unJs 

tJermI opcratnig funJs 
')ther funds 



Course conti^t liour^ 

Sectitw olTcfin^i^ 
{fall <]uaftcn 

Degrees a>[iferT<Ml 



Meagre s( huJgctcd salary siipp<m 
Ptrcent lenurcd 

Mcas*'^ of in^rruf^ttonai sUf^pot^ suff 
AVirragu salary infomiatton 

Raho of leaching av>E\iani FTl: as percent 4)1' faculty K1 1: 
Average salary infonutiiin hy -ank 



Measure of lotal Tinancial suppori 

Measure of siati? su;)pon 

Measuie of non.staic support 

Katio of olhcr funJ^ as percent of tiMal luitds 

Measure of total in^iructKirul service 

Measure of instructiunal service hy amrse levc^ 

Measure of tnstTu^;tu»n X oulpwt 
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Eimjllmenr Total siHtai QKdw 
hours (SCH) (exteiHkit day, 
acadcmK; year. SCH, excliuJing 
honors program) 



SCH by Jevcl 
10&-299 



.100-499 



600*799 



J 973^74 
1974-75 
r975-76 
% change 
estimated 1976-77 



1972- 73 

1973- 74 

1974- 75 

1975- 76 
% change 

cstnn<ue<l 1976-7'' 

)972-7J 
I973<^74 
1974-75 
J 975-76 
% change 
e&t:[natcd 1976-77 

1972- 73 
I973<^74 

1974- 75 

1975- 76 
% change 

e>nmai^ 1976-77 

I97Z..73 

1973- 74 

1974- 75 

1975- 76 
^ change 

estimated 1976-77 




Figure L Enrollment data elements and display fonnat for u.sc in college and department review. 



officers, deans> aitd department heads Smce the planning and 
budgeting needs of executive ofllcers varied somewhat from 
those of academic unit heads, a separate data analysis was 
performed for each group, 

E. Marketit^. With completion of the oai;. analysis 
phase of the review process, attention turned to the assembly 
of the analyzed data into a Plannhg and Budgeting Guide aixi 
its distribution to appropriate decision ma)cers. Actually, two 
versions of the guide were piepared: otte forcxecutivc officers 
reflecting their needs and one for use by deans and departnient 
heads. 

The guiue was packaged in a looseleaf binder to facilitate 
additions, deletions* and updates of the materials. It was 
organized as follows: 

I Introduction and Table of Conte xt^ 

II Policy Issues and Data Analyst A Synopsis 
lir Rev''' V of Academic Units/Pirogranis 

IV Hisiorica) and Projected Enrollments 
V, I>epanment Infoimation Exchange 
VL Appendixes 

A Summaiy of College Expenditures by Fund Source 
B. Employment Outlook for Graduates 
C Source of Data Elcnicnts 
Since a major objective of the review pioccss was to 
familiarize decision makers with the use of rr. uiP^^ment In- 



tormation at a tinte when it would be jseful to them, distribu- 
tion of the guide became a major concern. The strategy em- 
ployed b/ the academic and financial planning staff was to 
include tl^e guide with the budget request worksheets and total 
dollar allocdtions sent lo deans and department heads shonty 
aftei the university received its state appropnattnn. In ^d*- 
tion* the guide was reviewed with deans on an individual 
basis and, one ye9r> collectively at a regular meeting of the 
council of deans chaired by th£ vice ptesident for academic 
affairs. 

Executive officers received copies of the gqide shortly 
after the deans and well before the review of department and 
college budget requests, &.ch executive officer was given a 
private orientations J the guide to ensure that he or she under- 
stood its contents its potential utility, and its shortcoming^. 

F. Benefits. Reflection on the process of preparing c* ypm- 
lu^nt and program review information indicates that the fol- 
lowing benefits have been derived: 

1 , The academic and finarKial planning staff interest in 
providing planning and management infbrmatton provided a 
fonim fnr discussion of issues and concerns with a vancty of 
university decision makers. 

2. The staff were challenged to carefully consider data 
availability and utility, display formats, and analyses to be 
pcrfonncd t^fore plunging inio the task of data collection. 
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FACULFY 
PTE ^M^icieJ) 



Summer 



PTE icjvhtn^ ^ssi^tjnt^ 
[Od^hiAg felltH^s i rA/TF> 



T;* as a of factih> PTE 



1973 1^ 
74 

m4^7S 

1975- 76 
m[)-77 

change 

197* -71 
197 '^74 

197^-76 
(976 77 

1972-71 
1911-7^ 

1974- ^7^ 
1975.76 

1976- 77 

197 V 74 
1974^75 

1975- T6 

1976- 77 

r974^7S 
t97S 76 
r976-77 



1972-71 
197 V 74 
I974-.7S 
197^ ;6 
197^77 

I972.71 
l97.V'^-( 
I974^7S 
S97S-76 
:97iV_77 



fACJJLTY (torn ) 



FUND SOURCES 



funds f jciual) 



Orhcr funds 



0[bef funds a of 
[OTal funds 



F972 -11 
197 ^- 74 
1974^ ^ 
t9?^ 76 
1976-7; 



I97S. 76 
1976^77 



1072^71 
1971-74 
1974 -7S 
J97S-76 



1972-71 
r 97 V 74 
1974^75 
197^-76 
^ change 

I97f>^77 

1 972-: J 

1971- V4 
1974^75 
1975-76 

^ change 

1972- 71 
J97 U74 
1974-75 
J 975 -■'ft 



tNSTRtJCTJONAL DATA 
OntrNC contact liours ofkred 
f Academic ^eat tv^ ! 
on-^famptis inMniction 
excbulinij uijscMulCd 
reaching;) 

Ntiiiibvr of set-lions 
(fall qiLincr cxcludtnf l^hs 
or diM^ussion) 
Lov^cr 



Upper 



Gfadi-HPl-. 



B A /B S 



M A 



PhD 



1972 71 
197.1-74 
I974^7S 
1975- 76 



1972-71 
1971.74 

1 974- 7 S 

1975- 76 
(976-77 

1972 i 
J97U74 
I974^7S 
1975-76 
r 976-7 ^ 

197: -7 1 
(97.1-74 
19^4^75 
J 975-76 
J 97^77 



1972-71 
(971-74 
(974-75 
P975-76 
^ chanf»c 

1972-73 
1971-74 

1974- 75 
1975^76 

^ change 

^972-73 
1973.7 
1974. -7> 

1975- 76 
^ "hange 



Figure 2 Format fi>r colJcgg and ijcpurtmcnt review of f<)t.ult>. fund ^ourtg. anJ tnXruttional data clcmcnU. 



3^ Data coIJcctiijn oiid sub&equciit use provided an excel 
Icni [rgons to antique tht^ strengths diid AeakncAses of opera- 
tional data systems. 

4. Persons responsible for the collc^.tton 4iid reporting of 
operational da!a A^ere mfonned of ho^ thetr data Mere bemg 
o^eJ (o develop managenicnt mforniatton Suggestions vtcrc 
made land some MCie implemented) ret^ardirig the improve- 
ment of these data bases. 

5. fnfonnation included in the gijide vtas up-to-date, 

6. Data analyses were is^ue directed and simple ' com- 
municate and understand. Polity anal>s(s ^a^ faidttated by 
the availability of relevant information. 

7. Distnbutjon of the gutde to dcan^ informed them of 
the specific data used by executive officers m amving at 
resource allocation decisions. This awareness permitted these 
adnnmstiatoi^ to begin resource negotiations from the ^ame 
reference point. 

8. The guide contained data items often required by 
cjitefnal agencies, including accrediting agencies. 

9. Preparauon and distribution of review data <o deans 
and department heads lightened their load in preparing this 
information. 

In summ?i>t It should be emphasized that the lessons 
learned when preparing the Planning and Budgeting Guide 



have caused academic and finantial plaiLimg staff to be Lritti^ 
M hen aiial>£ing the data supplied tn . andaid operating reports. 
Where these data are inpnt directly £o a computer- based in- 
formaiion system, there mu^ *jc aMvar&ness of potentiaf problems 
coi.Lemmg the ^aJidity and reJiat hty of the system's cutput. 
The pteparadon. by handi of reports for use b> college and 
onuersity administrators ^ffe"^ the d^stirKt bencfiLs that Jen ve 
from ''hands on" e. perience. In addition* these efforts P^ve 
the vtay for eventual assimilation of the reports into a totally 
automated process. 

The folloAiving recommendations are offered to thu^ ^hi^ 
would Wish to follow the illusjation presented here They 
shouldt tn addition^ provide useful reminders foi those persons 
^vho rely on compute r based infoniiatjon systems as the s^ur^e 
of management tnfonnation. 

L There should be u^^oustant momtorjng of the soarvcs 
of operational dat^i and a cheek on the utility of such data for 
planning and management purposes 

2. Administrators Should oe cnLOuragt^d to identify the 
issues and LoiKcms they MJsh to have ddJressed btfurc data 
collected and analyzed. 

Persons or office^; where data is ^neraicd should be 
lapped ds A jtourtc uf cxpcrti.sc v^iXh in^t^ht^ mio ihc i^uahty 
and meaning of the data provided. 
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4 SuMkrcnt tjmc ^houlJ t>t^ alfowcJ foi Jaij anal>^i^ 
Lcforc reporting 

^ PriXTcJurCb for mluniuNon <.ollutitin anJ update -jhu^uIJ 
be tlu>rou^hl> JocumcnieJ ^-^ thj( u^iV^ ^an be pcrdinvicJ l>> 
cEertcal \uii unJer supervision This j-jiurcs <.4>ntmult> of 
eH^>ftb anJ comparabiltty of Jala 

6 IntViimiution ^liaulJ l^e Jis^cn>ina(cJ widely a<* organi- 
/iiitonal policy will poniii: This will help ro negiiic rbc necJ 



for i^ollcgc^^ anJ orrpartments ro mamrain separate le^orJ^ or 
hire anjiyncal Mudtcs ^laff of their own 

7 Efforts to jiKrcase the number ot organi/auonal unib 
coiereJ should be made vFyr c\*tiiip]e. efforts arie underway 
U> des^elop and repi>rt planning and mtUiageineiU jnlonriation 
for use by ihe university libraries, sludent scrv?ccs. and division 
of continuing edue;3tion > 



TRANSLATING GOALS INTO MEASURABLE 
OBJECTIVES: RESEARCH STUDIES AND 
PRACTICAL PROCEDURES 



Leoi.ardC. Romney 
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In a recent cs^ay on university goais, Conrad (1974) pomu 
out that goals (?) ate standards against ^vhich tojudg^ succcj^. 
(b) provide a source or legitimacy which justifies the activim 
or an oiganizaiion. (c) define oiganizationa] needs and prioriticsi 

(d) define production units for ''outputs'* for the organ ization^ 

(e) define the organization's clientele, and (0 <lefine the natufe 
or the relationship between the organization and society. He 
also points out that 'in most universities, goals arc of^en 
implicit, residing in an extended body of collective under- 
standings rather than in explicit statement" (p. 505). He goc^ 
on to say, "Mf university goals are to serve the purposes ljstc<l 
above, they must be identified nrorc precisely /* 

The goals ofspccifrc colleges and universities have tradi- 
tionally been described in broad, vague, high sounding, andi 
oOen, intemally inconsistent terms. Sueh a situation did not 
cause any major problems as long as people fully accepted (he 
tntrinstc value of a coi lege education and as tong..^ the demands 
made on postsccondary educaCton institutions remainvJielativel> 
stable However* during the Htties and sixties* ^ ^stsecondary 
educational institutions* m particular those in the coliegiate 
sector* came under increasingly severe pressure to grow in 
size andcomplexityand to meet the diverse needs, desires, and 
expectations of many rte^v groups throughout society, [n response 
to these voluminous* diverse demands being made on them* 
institutions often found themselves trying tc become everything 
to everybody In the process* colleges and universities of alJ 
types grew increasingly alike; they tended to lose rtieir individual 
identities as they pursued an ideal typified by the university 
model As a result, tlie purposes* goalSi objectives^ antf priorities 
of institutions have not been very distinct, nor very apparent 
even to stu^^nts* faculty, and administrators. 

[t isappLirnt that the problem of goal setting becomes one 
of identifying and clearly stating the following. < t ) what it is 
the inst' uiion is trying to accomplish* (2) whom h trying to 
serve, (3) how it intends to accomplish its objectivesi ant* (4) 
how much it intends to accomplish and how well n intciJstudo 
it. Without answers to these <luestions* an institution cannot 
really speeify its purposes and goals ^sufficiently to icct its 
internal needs for direetion. It also becomes difficult for it to 
stake out its claim to some special place in the lar:gcrpostsecondary 
education community. And* unless institutions get do^vn to 
tangiblci concrete levels of spcoifict y* it is impossible to really 
answer the^e (Questions The key to solving the probtem of goa^ 
setting is eoncrctL-ness or specificity There seems to be wide* 
spread recognition of the problem but limited capaibi 11 1> to deal 
with it Institutions have found that dealing in the abstract with 
the de velopiiicnt of goals and objectives has proved to be a very 
frustrati'^ig experience they can often identify and state tlicir 
goats in general terms but eamtot make ;hc crucial leap to thi* 
translation of heir goals into objectives in terms specific 
enough to be effectively ^ted upon and assessed. Develop^ 
mental work on the development of institutional and organiza- 



tiunal unit goalsi conducted by the National Center for Higher 
Eduudtion Management Systems INCHEMS) at institutions 
buch as South Dakota Stale University and Kalamazoo Valley 
Community College ha& further emphasized the need for concrete 
guidelines and altemari e strategies for deciding about goals 
and, especially, fur translating these general goals into specific 
objectives. 

Translating goals into measurable objectives to be pursued 
by the institution is the ^tep that gives eoncrete and ^cific 
expression *o the institution's purposes. It is also a step that is 
especially difficult to achieve. In translating goals into measur- 
able objectives, all of the issues and complexities related to 
ouicomes identification and measurement come into play. In* 
ability to state institutional purposes in specifici measurable 
temiji often hinders* if not precludes* assessing the extent to 
which goals have been achieved. Moreover* lack of specificity 
also increases the diffieulty of effective eommumcation ^vith 
institutional constituencies* especially external constituencies 
from ^vhom pressures for institutional accountabiUty anse. 

In translating institutional gi>als into measurable objectives* 
a major difficulty is identifying the pieces of evidence that 
demonstrate progress to^vard the achievement of the established 
goals. One faetor contributing to t *\ difficulty is that the 
persons responsible for identifying uutcome measures most 
often start from scratch. Ftirthermore^ as the goal definition 
process* there is frequeritly difficulty in reaching agreement on 
specific measures because of the variety of interests, perspec- 
tives, and expectations. 

The purpose )f this paper is to describe two studies which 
researched <)uesti^>ns related to selecting specific measures to 
be used in goal translation and evaluation processes. In additioni 
these efforts provided prototype methodologies that could be 
u.scd by institutional personnel to support the object ive*settmg 
procesSn These studies were the follo^ving. Institutional Goal 
Achievement. Measures of Pri/g|e«s iRomncyi and 
Higher Education Outcome Measures 1< entiftcation Study 
(Micekand Artiey. I974J. 

These studies and their impheations fcr the goal translation 
proccjis are discussed tn the following pages 

Institutional Goal Aeh^evement UGA); 
Measures of Proj,*^ 

The IGA study ^vas ^tded by the follo^ving purposei.. 

1. Assess the interests of three eampus const itueneiei; 
(faculty* administratorSi and trustee%) m being involved in 
institutional goa)*setting and assessment processes 

2. Examine the aeceptability of speeifie goal aicas tor 
planned outeomes) to these three audienees in six k'nd^ of 
in^ititutions 

^. Assess pCi.cptions as to whieh goal areas can be 
measured and how they can beir*ea\ured»as vie^ved by trustees* 
adminijitratorSi and faculty 
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4 Gather itifuntidtLon rogtirJin^ pc^ccptii>^^ of the jppri* 
prititcncss uf spLciHc kJnJ^ jnfunniitiun 4:1 fT^ctl^u^c^ 
pru^re j%tuv^tirJthetichievcmctitufbrodJt> sUceJ jn^ti[utiirnaJ 
goals 

5^ bctefminc if the ^ppropndteness of the fTKasu^c^ Kt( 
progress tov^ctrJ the dchicv*fmcnt vf jnsiituttunjl gvA dxcti^ 
^unes sLgnjfic<tntf> timon^; the three cotisiuut^nt groups 

6 Determine if the appropriateness of the measurH^^s of 
pru^jresj* fur JifTerent instituttonal godJ ama^ vanes significjr.ll) 
among six types of institutions 

The MuJy population consistc<i of 1 150 faculty, trustees, 
an J 4Jmmistraton> from 45 colleges anJ universities throughout 
the country Thes€ insiJiution\ ;fcere classified mio six mjjur 
categories, as follows. 

1 Public di> "toraJ-granting instiiutions (7) 

2. ?nv3te Joct<>ra] -granting institutions (3) 

3. Pubtic c^Jlr.p(x^hen^ive umvcrsittes ami colleges \9i 
4 Private comprehensive umversitiw^ anj college^ 
5. Lihcral art.seo][eges<l2) 

6 T^^o year colleges and institution\ i 10) 

Facuii> anJ trustee respondents to the ^tud> ^ere chosen 
randomly, whereas administrators ^^erc selected on their spccifie 
mstttutional responstbility. The purvey instrument to Mrhicii 
these mdividuals ;vere a>kcd to rcijpond cirn^nted of i^o 
principal sei.tions The Hr^t cirntaincd demographic and jdcnti 
fjtng mformatiun about the respondent The second dealt with 
lnwas^i^:^ of progress firr iwent) broadly Mated jn^itutiona) 
goal area*. The g5>al aicas ^ere derived from the Institutional 
Goah Inventory ffCI) developed b> and with penni^.sjon 
of the Educationa' Testing Service (BTS^ The Id consists of 
several spccifie gcal statements in each of 20 institutional goal 
areas. 13 of v^htc^ are designated as outcome goal areas. The 
reniaining 7 arc labeled p^oce^s goal areas by ETS. 

Associated tth each fCI goal area on {he stu(l> qtkTstJon^ 
naire uvere sets of 4 hO 1 1 measures of prl>grej»^o^posMbIe ttems 
of infoimation to be used to demonstrate progress toward the 
achievement of the (;oalareainqucMion. All in alL respondent^, 
in addition to the 20 goal area^. were asked to respond to 125 
measures of progress These measures were developed and 
amtnbuted by the staffs of Nf'IiEMS. WeMem Interstate 
Cojnmtssion for Higher Hdueation (WICHE), and the Higher 
{Education Center ofthe School of Evocation at the UmverMty 
of Coforadir. }n additton. a panel of experts, identified b> the 
author and ^tafl members at MCHEMS. rc wcwed and suppk 
mented the list of measures 

To complete the questionnaire. re\pon'Jents were asked to 
rate the dcgnre to which each goal arn^a vhtrold be a goal of his or 
her institution Secondly, the respondent wa^a^ked to indii.ati£ 
the degree to which each item of information was considered ro 
be an appropnate measure of progres\ for the goal area 

Ftndtngs of the institutional * achievement study. 
The Mudy piihjuccd a wealth of 11 uation. only a smalt 
portion of which ha\ been thoroughl> examtncd A detailed 
examination of ihe re^ult^ and clmctoM4>n^ obtained tho^ ft^rarc 
recorded elsewhere (Romney. I976J Only those result^ that 
relate directly to the topic at hand, namely tran^]attun of 
instituttonal goals int<r measurable objcettves. are reported 
here 

1 Generally, the appropriateness of mea^u res of p^t>gres^ 
for dcmon\trating irvMitutional gi>al aehiecenient dtd not vary 
across the facolty, trustc■e^. and adm|m^trator^ There were 
only Mjven m^tarKe^ in which siews of the three lypes uf 
Te^p<>nJent^ differed Mgnificailtl> Trustees and adTm^l^trator^ 
d.ffereii only s, itli rc^liard to two mcusuies 

(aj Scholarly wo^k^ pnnluced by students aiid/or former 
^tllde^t^ that arc u>nMdcred suitable for publication jruMec\ 
rating this lo^^e^ than did admlnl^trators) 



(b> friNtitutional policies and procedures deseloped to 
prutcvt the exercKse of academic freedom by facult> anu students 
{trustees rating thl^ lower than did adir^irjistrators). 

Trustees and faeuhy ratings of appropnaieiKss differed 
only for one- measure, 'mstitutional policies and procedures 
deveti^i-^d to protect the exercise of academic freedom by 
faculty and students'' faculty rating thi^ significantly higher 
than did trustees). 

Administrators' and faculty ratings of the appropnaien^ss 
of measures of progress differed sigmficantly Only with regard 
to five measure^' 

(a) 5atl^factlon of ..urrentl) enrolled students or rv' ^nt 
graduates with thetr academic development ladministr^ >rs 
rating this as being more appropriate than did faeuhy) 

(b) Student/faculty ratios (faculty ratirtg this measuie higher 
than did administrators) 

(c) Amount of release time granted to faculty members for 
community service (faculty rating this highei than did ad- 
ministrators) 

<d) Avaitability and use of an institutional information 
^)^tcm (administrators rating this higher than did fa<.olt) mem- 
bers) 

(e) Satisfaction of students jnd former stodents with ibt^ 
extent and nature of their educational cKpcncn<.e and sub^e^ucnl 
employment (administrators rating this higher ihan faculty), 

2. The results suggest that if the following 14 types of 
information were collected^ progress could be demonstrated 
tirward the aehicvement ofthe 7 most tmponant goal area^i^ for 
eachof the 6 institutional t>pcs Moreover jhis evidence would 
he acceptable generally to at least the facultyi. administrators^ 
and trustees in e^ch type of insutution^ 

<a) Student ability to apply knowledge 

i ) Continuing active intellectua! involvement of former 
students s>thcr than formal^ advanced study 

(c) Course offenng^ md institutional opportunities per- 
taining l\j the itcvelopmcvit of intltvidua) ^uals. valiies. and 
personal growth 

(d) Students and/'or former Mudents expressing c<incem 
for huriian welfare and well-being 

'e) Employer satisfaction with former student t^>Latiorul 
or p*ofessional training 

(0 Scholarly worLs moduccd by graduate students and/or 
fonner graduate stodcrts considered suitable for publication 

Basic rescar(npublicationsirrotherrcsult.*vS)fscho1aTl> 
effort produced by students or faculty members during the pa^; 
year 

th> Bvaluatlon^ and perceptions of niembcr\ of ihe com- 
hiunir> regarding the ijuality iti mstituti^'fial serv^ev available 
to them 

{i> F.Mstence of spc( lal courses and prv^grams to meei the 
needs of particular ^iroups of stu-^ms 

ij} fnsiitutional policies and procedures developed topriv 
tect the exercise of academic freedom hy faculi^ and Mudenis 
k) Attendan<.e and panicipatiirn by faculty m the faculty 
scnait or similar body 

t[> Faeuhy and staff tx^rceptions and evaluations of interr^al 
morale 

(m) Student and/or faculty attendance at eidtural activities 
vponsored hy the institution 

inj fnipaclsof nnxJi locations made jn coui>cs and pr^i^ranis 
3 An exjmirution of these 14 itents of infomiation rn; veals 
adecioc^J lack of compatibility wiih measures c irrentl^ u^ed to 
pfv>vidc evidence of pr<H]uciivity For ;xampi:. m .t siud) 
conducted todeteniime w^hich outcome measures of community 
^.ollc^es areeoKeeted by state agencies. Kirinisori { I976j found 
lliat mosi arc rei^uireO to supply information on (he number of 
students enrolled, full time equivalent students, and T ^rces 
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NluJcnt/fdcult) fixiiKfs l>piL<tl]> loIIclIcJ niLti^urcs Vc( none 
or ihcsc measures was rated ac^ highly approrHatc in (his study 
In TacL Ihc mt*asurcs now in use icni (o conform more in 
orientation and subslantc to those rt'jct^tcd by ihc partieipiants 
rhis apparent Lonfticl tan have some impunanl impJitations for 
inslilyttunal management and producluiiy as well as for slatu- 
widc Loniro] and coordination If (he tKem^ of enumeration 
sorvues as the v^a> lo provide uvidenee of aveountabilit> . 
inslilulional adminjstrator^ and faco]l> [Tki> bcgi.« to opcr^ilc in 
aetordant^ \^ith r4dKall> different insxntive stniUuies Lm- 
phas«<> on quahl> and impact ^oold pale in the light of j^^^rce 
production and body counts Indeed, it is suspected that most 
intenlives would operate to maximize degree produUiun an^^ 
body eounls. In such a situation. aJ] panieipants lend to lose in 
lertns of Lmpa<.l and salisfatUon. The measuits found to be 
appropriate pieces of evidence provide an e.^npirKall^ ^tubstanli 
aled base for such a ehange. 

4. In a different vein, tht; results of the slud> suggest some 
LonclusLons rcgardjn^ the development of goals ^nd measurus 
uf progress for these goals Respondents from six t>pe^ of 
mstilulions fromallpansof thetounlry tvcrc partiupanrs in this 
slud> In general, it tan be said that consensu5i was rca<.hed 
across all types of institutions as lotne appropriateness of some 
gOii\ areas and measures of piogress w ithin Ihc^ goal areas (n 
some cases, consensus regarding goals and their measores was 
rcsln<.ted to agreement within pariKuldr inslilutionat types 
Therefore, li is suggested that the process of velctljng in^litu- 
llonal goals and appropriate measures of progress can uliHzc 
<.onM.nsas building techniques and thai thc^ te^hmques are 
oseful wjihin indivjdual institutions, wuhin^syslem^^of simdai 
types of jnstitutionfi. and across a conglomeration of several 
t>pes of institutions The number of goaU and measores thought 
to be appropriate must likely will decrease as the di\ -iy of 
Institutions involved in<.reascs. Yet the task of tdcntifying 
perceptions of i^om^non purp^s and mea^otles of progress 
tu^vaRl their achicvcrr^nt y^nis lobc feasible as ^ ell ^is necessary 

ffigher Education Outcome Measures 
Identiffcation Study (OMIS) 

The OMIS tvas initiated pnmardy to siudy and deveUjp 
procedures for LoHctting outcomes and associated measures 
deemed riKjst important to different t>pesand levels of detisiun 
makers The uhjeetives of the study were the following, 

I To l*^am ^hat outtonie information Oiui^.^em decision 
makers need for their decision making respunsibjli les 

To learn \^hat outcome information currently is avail- 
able to them 

3 To identify a high pn^jnty tist of outcome measures fi^ir 
vvhith data acquisition pri>Ledores need to be developed 

ONfIS survey questhJFinatrcs were sen^ to randomly 
selected vollcge administrators tinduding 97 presidents. 97 
1. h I cf academic i^tTicers. thief student affairs i>ffi<.ers and 97 
thief fiscal offKersj and 125 state level decision makers tin 
^.luding 75 statcwfije planners and 50 state legjslators> The 
inerall response rate for the <>tudy was 58^ Responses tverc 
rccci ed from at least one admintstrUor in 95 uf the 97 
infititutions inehidcd in ihe pool. Whereas 235 (61%) of the 
^.isjllcge administrators returned completed OMIS questionnaires, 
only 64 {5\%} of the state level panic tpunts re^p^ndcd 

The paniupants in the study were asked three types uf 
questions ThL first question a)ncernedtheextent to which they 
felt they needed information about eaeh of the ten outcome 
information categories delineated in Section I of the que^ tion- 
naire (^see Micek and Amcy, 1974) The second major q^^st ion 
dealt with the extent to which each respondent felt the need foi 
euvh of the spccifit outciime measures listed tn Section 2 of the 



questionnaire The final question p^nainc-d to his or her .t^^ess 
to. or abdity to obtain, each of ihc out^umc measures prcserit^-d 
in Scetion 2. 

Findings or OMIS study. Detailed results uf the OMIS 
project arc reported ulsevkhcre tMicekand Amey.^974> How 
ever, the following are a fev^ eXcerpts from (hose findings that 
are djrcctly related to the gual translation process 

I ^ Three measures m the OMIS eff^Hi were given a high 
Neud to Know endorsement by all six grimps They wc»rv 

lai Number of stodents graduating from (hv institution 
after a eenain pcrn>d of time a percentage of their entering 
class 

(b> Number and percentage of grc^duatcs for the year who 
ttansferred from another school 

te J Number and percentage i.»f .students kavingthe institu- 
tion prior to re-^eivmg a degree, djptoma. orecrt^ficate dunng a 
panieular aeadcmic term or year 

Jn addition, five measures Aerf^ ^iven a high Need To 
Know endorscnfKnt by at least five of the sia groups. 

ta> Number and percentage of students surveyed wh^j were 
taking non^redtt. independent study, ur <>pCeia[ eourses 

lb) Number of students receiving a degree, diploma, or 
cenificate within a cenain time period 

te> Average amount of time it take^^ a student to earn a 
degree, diploma, or certificate 

td> Stodcnt scores on a scate measuring the degree ot 
satisfaction with their progress m achieving their oceupatiotal 
career goals 

4c) Number and percentage of fiimer students tgr^dutites 
and nongraduates> surveyed who were employed within a 
certain timt after leavtng the institution. 

1. Interesting similarities and differences t^eurred among 
the SIX respondent gruups Wiih the e^iLepiion ^^^ the group of 
ehief fiscal administraton>. the top-ranked measure for each of 
tl.e groups vvas m the outcome aieacntitled Student Ldoeational 
Career Development, The following identifies some highhghts 
with respcet to each of the groups: 

4a) Prestdenis — This group endorsed the widest range of 
outeome nneajiurcs P^sibly this is a result of the wide range of 
decision making responsibilities encountered by people in this 
group. Two measures were unique to this group. 

\b} Axtidemtt ajfiursodmtmsirafors — This group appears 
to have the greatest need for measures relating to Student 
Knowledge and Skills Dcvebpment. Student Educational Career 
Devclopinent, and the Development of New Knowledge and 
Art To some extent jb.s was to be expected, given the planning 
and management responsibilities of respondentia in this group. 

4e) Student affairs Lu/fnmL\lr^rori— Respondents r. this 
^roup appear to have concentrated on measures concerning 
Student Educational Career Development. Student Ediieatiunal 
Satisfactiun. and Student Oeeupational Career Development. 
re<.pcetively. Of all tbcgroups* this group indjcated the greatest 
need for Educational Satisfaction measures It i^ interesting to 
nuis^ that, of the five measures unique to this group, four involve 
student perception abfjut their educational piogress. This may 
suggest that student affairs administrators are mijre receptive tu 
this kind of information. 

id) Budi^e^ undfmatiKt tiiiminuihiton -As e^pceted. re- 
spondents in thi.s group favured those measures directly linked 
to finaneul data, Eurther. each oi the five measures that were 
cndiirsed unly by this group eoncerned thu ac^uisituin ijf 
ftnancia' data 

(e; Suife if, el (}Uuimn- This gnjup of respondents cn 
dortC^J many of the sdine measures coneemiryg Stud^.nt lldiica 
tiunal Career Development und^rrNed by thu respondents <n the 
four j,istitutional division maker gruups Of all the gri>up>p 
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stale level planners favorecl the greatest number of med^ure^ 
associated with Student Oceupi^tional Career Development. 

fO State tegisiaiors—7ht^ ^roup concentrated its major 
:ittentjQn on rneasures associated wuh Student Knowledge and 
Skills Devclopmen;, Student Educational Caiecr Development, 
and Student Occupational Career Development 



Implkations for Coal Tr^i^slution 

As stated at the ou* ^t, goal translation *i the prfH,e^^ of 
stattrig irtstitutional go«b in specific , measurable terms* th^tt is* 
statmg them in te''ms of measurable objcLti^cs This gudl 
translation process can be disaggregated tmo the following* 
greatly simplified >teps! 

1 Identif^ationof the full range of goals . rtheorganjzatjon 

2 Selection of those goals that ^ill be most impurtdnt 
^ Identification of the kindsofmfonnation that could be 

used to assess the degree to wht^h the high priority goals are 
being accomplished 

4 Selc% tion of the mfoimation items (e g . outt^omc and 
envrronment measures) that wilt be used to assess levels of goal 
attammcnt 

5 Preparation of Dbjccti ves stated m term!, of ihe mfontta 
Hon Items selected previousl> as well ai the judien^^ for ^hom 
they are intended and the mimmum performaiiLe levels expected. 



The reader should rctogni/c that the goal translation 
prof.esAt a ver> complex exer^i^ indeed* is only paniahy 
supported by the study procedures and findings recounted 
wtthin this paper. For example. 

I ' Both the IGA and OMIS procedures can be u^fu to 
assist decision makers in the goal selectim (Step 1} and measure 
selection (Step 4) procedures outlined previously 

2 The questionnaires and results of both studies may 
serve a"" resources during the g'^al and measure identification 
processes (Steps I and 3 respectively). Clearly* however there 
are numerous sources of goals and measures that might be 
referenced- Relying on these two studies would limit the 
of the goal translation exercise. 

3. Individuals involved in the goal translation process 
should consider measures of the types preferred by decision 
makers and postsecondary education participants m the IGA 
and OMIS studies, that is, measures of measurable impact and 
satisfaction. 

>i conclusioni the authors suspect that not only are the 
procedures of these two studies useful for addressmg portions 
uf the goaJ tnifisiation prubtcm but alM> that when they aie u^ed in 
individual organizaticnal units* institutions* systems or other 
populations as research tools* important msights can be gained 
about the outcomes infotmaiion preferences and needs of post- 
se^oiidar^ education panicipanis and constituents. 
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As multivariate statistical method:; become increasingly 
available and widely used, it is only natural ihat new v^ay^t of 
using these techniques v^ill ^ sought One possible app Ik aCiO'j 
of these methods^ ts the exploration of the large mat^Sk of d4td 
whieh arc gathered for l>oth rtiter- and intra ins^titutjonal 
purposes Ustng the methods <k>cribcd in chis^ paper, u \s 
possible to examine similarities and patterns m \tit data uollet^tcd 
and rn the objects that these data describe, whether they be 
faculty members. departtnents, or m^titution^. The pitfp^jse of 
this p3per is to descnbca senes of muhivariate studies dimed at 
explonng th^ underlying dimensions in an institutional data 
base maintained by tbc Association of American Medical 
Colleges ^AAMO and the patterns of similarity among the 
mstitutions * The undeistanding gamed from the idcntifluaiionor 
basic dime nstonsofdifference and the grouping and mapping uf 
similar <^chools can guide dec isk ions that aftecitheM; mstitutivms. 

The purpose of the analyses descnbcd in ihis -per wa^ not 
to answer speeiflc questions but rather to systematically probe 
^fxist^ng data to illuminate arca^* of potential mteix^t Tor further 
mvostigation and to generate research qucs^tkonsk and testable 
hypotheses It cannot be stressed too often that the analys^es 
dcscnbed inihispapcrarc exploratory They sverc des^igned and 
conducted to **map the territory"' existing in a heterogeneous 
"nmprlatton of quantitative measures of the mstituttons of 
nicdical education in the United States Further^ the analyses 
described here are secondary analyses, usmg data mmally 
gathered for other purposes (primarily institutional accrcdkia- 
fion). to enhance existing Knowled^ about the process of 
medK'al education from an institutional perspective. 

The stuc'^^s described in this paper used three differcm 
multt'^riate statistical procedures, factor analysis.* cluster 
analysis, and niultidimensional scaling Bnefly, factor *malysLs 
IS essentially a means of grouping variables \^hich conclj't 
with one another By illuminating groups of ^artables ihal are 
related to one another and that may be thought of ^s being 
related to a comnon underlying dimension, factor an^ilysis 
simplifies somewhat the examination and interpretation of the 
fuU set of correlations between all pairs of vanabtes Ctusier 
analysis and multidimensional scaling, the other analytie pic^ 
ccdures used, are methods of creating simplified models of 
instituttonat similarity based on several empmuil or derived 
measures Cluster analysis sorts institutions mto gioups such 
that tne schools in a particular group have similar values on alt 
of the variables, while different groups have dissimJar value 
profiles The third technique, multidimensional scalmg, pro- 
duces a m^'^p of institutions in fewer dimensu^ns than v^ere 
present in tlu^ ongmal data in such a way that distan^'^s the 
map correspond closely to the numerical similarity amon^ the 
institutions 



Procedure 

AAMC's Institutional Profile Syslem ilPSj is the com- 
patenzed repository for mosi of ihe institutional daia collected 
by the association. In August I976» there were more than ^,000 
daia elements from over ^ different sources in IPS. Many of 
the data were longitudinal repetitions of the same variable for ^.s 
many as 15 years i 1959-60 through 1974-75) The data in IPS 
come from ^ number of different kmds of purees including 
annual surveys, special purpose surveys and ^uesttonndlres» 
and other AAMC and non-AAMC data bases from which data 
may be aggreg ted by institution. The other, noninstiiuiional 
databa^^s describe applicants and studcnt±>, faculty » and research 
grant applications. Dataclements from the most current sources 
m JP5 were imtially screened for the preseni ^enesof students 
using a number of criteria including completeness, laeK ot 
redundancy with i>ther measures, and ^ poienrial for revealing 
previously undescnbed dimensions of variability among msd- 
rutions. In additioi» a number of relative measures* such as 
ratios and percentages, were computed from the existing vari- 
ables. The initial screening resulted in the selection of 13^ 
variables from four general domains, institutional charaeier- 
isticsf45 variables), student 140)* faculty 122), and eumculum 
(32) A series of preliminary factor analyses was pertoimcd 
withm each of these four domains to reduce the fmal set of 
variables to those that were n:x)st complete and which described 
the institutions on a number of meaningful dimensions. 

The final set of 33 vanables on which the analyses desenbed 
in this paper were based consisted of 14 student variables. 13 
mstituttonal measures. 4 faculty variables.* and 2 cumeulum 
variables. The proportional representation of the variables in 
the final daia set was due^ m part, to the predominance of 
student data m IPS and the qualitative nature of thecumcutum 
data in the data base. The final data set also consisted predomi- 
nantly of retaUve measures, ie.g , the percentage of medical 
students who are fetnale) rather than the origmal raw cx>unrs 
contained in IPS (e g., the number of medical students enrolled) 
preference ^as B^ven to relative measures in order to allow 
insXW ^'onaUharactenstics other than overall size tobe exposed 
in the analyses. 

The first step of the analysts ^;^as the factor analysis of the 
3.^ variables selr^ted from the most recent data in IPS, The 
factor anal^**c method emploved was principal components 
analysis The first nine components extracted from the correla- 
tion matrix* which accounted for 7474 percent of the variance m 
the data, were retained for rotation. A number of vanmax 
notations were performed in which different numbers, of the 
components, ranging from 9 down to 4, were mtated. The v." si^ 
SL>lutions were then ci^mparcd, and ihe etght-compt^nem stjiu^ 
turn was seleeted is x\k most interpretable and intuitively 
appealing 



'The w^kfin ^hkcbihis paper hased vtjc^ p^rfumicd pursuant hK%»ntT<M No 76 001 1 \hiih the Hcallh KcsourirC j^dntiiik^irjiiun. IX'p-tFtnicntot 
Hcalib [:dikcation and Weifaiv Refcrcv^e^ t^^ jndjvrdual rcp^ifts ar\cribifi{; the ^tudccc tn JmkI arc ■ncluot'd in ihc rciervfhcs nf ihh p,ipOT 
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The i^lustor tinal^sJH pcrfornioJ jn thin stud> v^tw dtmc in 
Ivnj Mcpi In ihc firsi iTcp ^^^ the «.iuitermg priKtvss, NOUS 
mcdKa' scht>oU worc hjcrar4^hKalt> i^Iustoned on the bdbks of 
thejr values on 8, 6, and 5 faUor s^oki> u^ing d tc^^hnit^ue 
developed b> Ward (1963) Tbc!<lhwcunal>i>o> >^eiri,t>rhlu«.ted 
to a^^ess the ^mputt of scle^^tcd f JUor svorei on the hicraPthK^il 
bolLitjon Ho^^evc^> hieruT^^hkal ^^lu^tor anal^M^ Toi^o^ all o\> 
jCi^is under conMJeruuon lo be i^ombincd. Ihefeb> allowmg for 
Jisiijriion of ndtur;il ^^luA'ri by jn«*luiJijn of out]>ing objCtti 

The ^e^ond ^^tep of the i^lusleranjI^Mvptotedure jnvolt^J 
uving ihe results of the u^ranchkul i,luster analy^i^ to imtLate a 
reflncmeniorihe dcH' Jclubi.<^ thraugh un iterative ^^lu^ter an- 
dl>sii techniqw Jj^^ joedfor Fu.^> (l%5) vthith mmimtz«:> the 
differences of obje<.tb vtithm clatters without the arttfLCidl 
pcrmanen^^e of «*lUiter membersh p inherent m the hierurthKal 
approach In the second ^tepof the ^^lu^tenng, this method wa^ 
appljed several timc^ toderive^^luster^otutton^ ranging from 12 
elustersdown to 6 using faetor scores as input. From tfie variety 
of posiiible elustenngs, the S eluster solution was seleeted for 
presentation based on its representation ofthe schools and their 
similarities. 

The final phase of the analyses in this senes involved the 
application of miihidimens tonal scaling, separately to public 
and private schools, to derive spatial maps of the srmilantres 
among the schools. Similarity matrices for the two groups of 
schools were submitted to hoth metfie and nonmetrie procedures 
Metnc multidnnen^ional scahng is a i mputational algorithm 
that j^'xpts an N-by-N <;ymmetr(e matrix of similarity (or 
dtsvimiiurity) measurements between all pairs of Nobjjcts, and 
produces a set of spatial coordinates for each of the N objects. 
The mathematical underpinnings of metnc multidimensional 
scaling are detailed in Torgerson (1958). Basically, the input 
matnx of distances is translofmed and then faetored by the 
pnncipal axes method. In metnc multidimen<^ional "^aling^ the 
distances must be established on a ratio scale of measurement- 
The more recently developed method, fionmctnc multidimen- 
^u>nal scaling, requires only ihai ordinal assumptions be made 
of the dissimilarity measures (Shepard^ 1962)- Similarities 
matrices for both groups of schools were computec from the 1 2 
variables which defined the two factors, derived by factor 
analysis, descnhing graduate medical cJueatkm emphasis and 
research emphasis The two simiUritics matrices were scaled 
into 3 dimensions and into 2 dimcnvions using both method** 
Thus. ^ models of medical school similarities were developed 
and compared 

Results 

The factor analysis ot Jt3 selected institutional variables 
prodrjced >i\ najor (and two minor) independent ditnensions of 
vanation among incdteal schools, which formed the basis of 
ttie subsctjuent analyses The si\ major fa^:tors, and the vanabies 
from which they were fonned. are presented here in Figure I 
The first factor combines a number of varia«>les which assos>. in 
different ^a>s, the degree of graduate mc Jtcal edueatton eni^ 
phasic m medical schools Factors 2 and 3 measure the si/e and 
age and the degree of public and private control of the institu^ 
tums (In the latter factor, schools with high scores are similar 
t<i most pnvate schools^ while schools with [dw scores htc 
similar to public medical schools )The vanables which make up 
Factor 4, w^h the exception ofthe percentage of female tnedical 
students, measure the research funding sulxcss of the schools 
tin applreations for new vingle^investigatorrcsearchgrants from 
tfie National Institute^ of Health (NIH) Factor 5 assesses the 
degree o( uurrcnt gr<}wth among institutions^ and Factor 6 
meas un;s the e \te nt and emphasis of spt^nsored rcscdKh a^ti s it> 
among the schools 



Factor svores \^ere t^oniputcd for I lO medial s^^hools <wi 
the sj\ fa^^tors Jcs^^ribed above^ The fa^^tor svore^ vn^ere then 
used as input to luster analysis, the results of ^^hich arc 
presented in Figure 2 A Final i^lustcr solution ^^as derived 
hith enumerated eight ^^lusters cif medial schools. The schools 
whuh foimed t^ach ^^luster are listed in the left-hitnd column of 
Figure 2, and the mean scores f^^r the s^^hools meach cluster on 
the si\ factors aie graphed as cluster proFiles. Cluster 1 is 
composed of 17 established medical s^h^^ol^ >^htch happen to be 
Wated primarily in the South and Mid^n^cst These schools vn^cre 
below the average of all 110 schools on each (Mor c*^cept size 
and age. In comparison. Cluster 2 consists prijiiarii> <ti |>ublic 
.^4^hools \fchn,h4re the oldest and largcMof ^n> of thegruupsbut 
^h^h are stdl grovn^ing and developing. Cluster 3 abo 
vomposed of public in;tjtutiunsi but^ in i^ontrasl to the s^^hools 
jn the first two clusters, the s4^h^>ols in Cluster 3 pl^ce heavy 
emphasis on rcseaixh and are K^.uivtly successful tn obinctming 
research funding from NIH. 

I Gradu Medivtil Education Emphasis 

t.ijic salary of associate professors of basic 
scieHi^i^s 

Ratio ol housestaff to medical MuJcnis 
Rutio of medical students lo fuH-t^mc mcdieal 

school faculty (-) 
P^-'centage of hvir^ mcdtcat school jiuiimi in 

general pntciice* - > 
Percentage of incdical schin^l faculty ate M I) s 

II Si/c and Aj*c 

Number tifmcdical studcnis 
Age of medical sch<x)I 

PtcrcTnitige of mcUKjl sth^tL aluumi v,\nt jk 
board ccitiH^fi 

III Conrn^t 

Coniiol (0 - Public. I - Pnvaitfj 
Medu M ^h^Mil luiiion for m-staic students. 
1975-76 

Percentage of iivstatc first year xncdicul >tu<km> ( i 
Ratio of applicants to first year incdical students 
Percerttage of revenue from federal s(iurces 
Percentage of revenue from gifts 

[V Re^earch Funjii^ Success 

Perceitt4ge of requested sm^te investigator ro^ * 

lunds a^^^ndcJ 
Meanstandindi/cd priority score- single:* estimator 

research applications 
Siiigle ir.vesti^ator re*<arch ^pplisain^n approval raie 
Pi^TVCufa^c of female mcdrcal s(ij<fcnts 

V Dcvol(Tptiicnt Stage 

Ratio uf v(»)untcer faculty lo full-time faculty 
E'uxeiit of «.hai^f!u msp<msoreU resc^r^h tmin WW. 
1967^74 

Pro|cv(c^ annuji perccm ^h^nge m ^nr^ininem. 
1974 79 

V| kcsearth Bnpliasis 

Number of Mn^lc mvt>ii^>ator r^M^jah ^tMi\ jppirusvd 
PcKcntagc Kti h'Ui tpenJiturLS for ai)mini>lr4lKm and 

^eitcrul etpenv ) 
ItrtentajiC of Jotal espendituivs for sponv^ircd resc^r^h 
Kati(> ot basic scicnco ^r^^titiiie stiKlcnis to 

medical siudcnts 
Adjusted tot^il pcsenue 

K'rteiKage of firsi->(.Mr niwlisal stutk*iit> w-itti 
uudcrgraduaie GVA s hcivn^ccn ^ 6 jnd 4 (i 

Pigure I Su factors and ui)tnponcnt variables derived 
fr<itii factor analyses f>f tncdical schi>ol i^har- 
acten.siics 
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Figure 2 Clusicr membership and profiles of cluster ccntroids on six factor scores. 



Cluster 4 is evtjiij disidcd belvtccn publK and pnvatc 
medical -.chtxils As j group^ (hcsc schools hjvi; Urge iinJcr- 
grjduaic mc<Jical education prxignims and the ',trf>ngt',t cjiipha^i-* 
on graduate nvcdieal education of ^n) of the ^r^^ups These 
schools also plac; higher than average emphasis Km research 

Clusters^ £nd 6 iirc both composed primarily of rcUivetv 
new, publie medical sehools Cluster 5 jntams the ncv^estT 
smallest, and least icsciirch- oriented sehools of an> of the 
elti^Uers (including »wo schools. Nevada and MinncM>ta Duluth. 
which offer only tw(i year basic scicr^co cum^ula) The schiHjls 
in Cluster 6 arc also rclatively new. hut the> arc the jnost rapidly 
developing of any of the &r*>iips of schools 



Clusters 7 and 8 ^irc hoth i^ojT,poscd primiinl^ of private 
nedual si^hm^ls, but the two ^rf>ups i.jve oppiising vhiiractcr- 
ist<vs The si^hooLs m Cluster arc sli^jhlly ab(>ve average in 
si/e and a^e but have relatively \im ett.t>hasis on graduate 
inejKal education or rcsc^rLh. whereas the chi>ols in Cluster 
H Ate slightly below average in si/e and iige i^ut place heavy 
emphasis on graduate mcdKal education rcsCiirch. 

Twelve variables which defined two of the facnrs derived 
in the factor anal><t^. research emphasis and graduate medical 
education emphasis were used ti? i^ompute separate suTj,*aritjes 
matrices f<ir public and pri 'ate rnedicnl sch<H>ls The<>c sin'iliir- 
tties matrices werc then usid as the ha<>is for muhidimcnsuMal 
scaling 
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MctfK multidirneniiianjl ^jling proUuLtd the maps" lyf 
pnvjtc schooK ondpubht s<;htH>K presented in Figures 3 and 4 
PK^ttcJ ptnnis represent the ^f^hwls. L4jng JiMan^es bt^twcen 
t^o pinnts mJjkdtc thdi tvv^? svhi>oK*ire Jiffcmnt wah rcspt^t lo 
the emphases ihej pl^iLe on rescureh and graduate nied^ai 
eduL4itJon progrjinis. 5Lhot.>ls plotted tlosc tiygether are stmjlar 
m these respects The vectors plotted onto the map were derived 
ustng regression ineth^xJ^; and serve to indieate the meaning o^ 
several direetLons on tbe map<; Tbe multiple eoaelation eoef 
ftcients, R, indjcate ho\^ \^el] the rjiap summarire^ eat:h 
wverjl sjngL measures The ^>rjentatLons (after rutationhif the 
hcst desvribcd veLtorson the pubhc and private ma[>s are high I> 



sjmjtar, giving some assurance that the same djmensioii.> of 
dtfferenee arc gencraHy applicable. 

The nt^ninetn^ muJtiditnen.siona) scaling results and their 
corresponding regression results ^crc nut notikCabl) djffercm 
from those reported, in all tdscs^ two dimensions scemeu 
sufficient to represent the simxlantites of M^h^iuls vvithreApL-i.t to 
the tw^elvc input measures 

Discussion 

The objCLtLves ^>r the stud> were suctessfull^ m^i through 
the use of faU^^r analysis, cluster analysis, and muUitliincRsii^nal 
s^almg. J large institutional data h*ise was explored foi p<xuli- 
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Figure 2 Tu'O-JjmenMoniil model >^f similarities betuvecn 44 private medical schools with respect lomcdsurcs of rcjcarth 
emphasis and graduate medical education emphasiSt with vectors representing best fit of several individual 
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Figure 4 Two-dimensional model of similarities between 50 public medicaUchooU with respect to measures of research 
emphasis and graduate medical education emphasis with vectors representing best fit of several individual 
measures, 
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antics and simpliryin^ patterns^ a number of interpreiablc basic 
dimensions of institutional vanation were idcr iiHed, institutions 
were grouped into describabic like categories* institutions were 
mapped onto dimensions for which no single measures were 
known to be adequa * axes, displaying a visual summary of 
some of the similaniies and differences^ of all U.S. medical 
schools. 

Jn the process* something was learned about individual 
institutions (To what schools is my school similar? How is it 
similar toand dilTerent from another school?)* about the institu- 
tions in generaKWhat are their basic dimensions ofdiflferenci?), 
abour the data base itself <Are the data accurate* complete* and 
comprehensive'*), and about the .^thocte in an interinstitutional 
exploratoiy research application. 3 ^me of the Hndings about 
the data and the tnethods are of general interest and are 
summarized in the following paragraphs. 

1 In t\e process of conducting the exploratory data an- 
alyses* seme deficiencies in the data were noted. The values of 
some variables for some schools were in error. Sotne measures* 
such as the numbers of clinicaJ facult) and the number of non- 
MD-secking students reported in units of it)edical student 
equivalents* were found to harbor problems of definition. This 
preeludcd their use in eonstnicting reliable new indicators and 
factor seores, Jn addition. It was noted that there was an absence 
of quantitative measures of eunriculum and outcotnes of the 
process of under;graduate medical education which reduced the 
comprehensiveness of these studies. Partly as a result of the 
exploration of the data base* efforts have been begun to over- 
come this deficiency. 

2 The methods were found to be sensitive to extreme 
values in the data base and to extensively missing data for 
individual institutions Often the cfTects were readily noticeable 
as extreme faetor scores^ lopsided multidimensional scaling 
solutions^ or schools that resisted being elusterod. When such 
effeets were noticed, they eould be correeted by dropping 
sui^pcet data or schools from the analysis. It seems unlikely^ 
however* that minor abcirations in the data affected the results. 

3. Twosehools with valid extreme values, it wasobserved. 



can cause corrclatjons high enough lo define a factor. The 
occurrence of a minority fauor was due to two medical schools 
that IraditionaJly admit a majority of students from ethnic 
minorities. Their faculties* too* have relatively high proportions 
of minority hiembcrs. The minority factor, while valid, isnotof 
general value since It distinguishes only two inslitutions from 
all others. ^ 

4. In some research applications* similarity measures are 
the result of subjective judgments or other forms of direct 
measurement. In the present study, similarities were computed 
from data using the Euclidian distance function. In this case* it 
was found, the results of metric multidimensional scaling and 
Ihe more expensive nonmetric multidimensional scaling were 
equivalent. 

5. It was found that imposing the cluster analysis model of 
medical school similarities with respect to six factors onto the 
multidimensional scaling model for two factors enhanced the 
Interprctability of both models. This was done by plotting 
schools on the map with symbols corresponding to cluster 
memberships. The general difTerences between gioups could be 
observed as well ^ the gradations of dilTerencc of schools 
within groups. 

The,i_ acem to be a variety of possible uses for the results of 
these exploratoiy studies. Planners at one school tnay wish to 
readily Identify anotherschool thatsharescertaii^charactensties 
for consultation about a related problem. Jhe groupings and 
maps can be used to select representative schools for sample 
surveys. The maps provide an instant overview of the universe 
of U.S. medical schools for someone needing to leam about all 
schools. It has even been suggested that the results can be used 
to divide an assembly of medical school deans into discussion 
Or dinner groups that are likely to share common interests and 
problems. The factor analyses raised several questions that may 
serve as the basis for further studies. 

In conelusion, the three multivanate tools were found to be 
useful in a process of exploratory data analysis that led to r^^ults 
having some potential for decision making. 
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The Problem 

Programs of insmiction leading to degrees traditionally 
have been regarded as the heart of the academic eniefprise. 
Collegiate institutions and t^ir faculties zealously claim the 
nght to detennine the scope and nature of their programs. 
Traditionally, this prerogative has been honored by those 
responsible for setting public policy. Govemorst legislatures^ 
state officials* and state boards, as a general nile* have resisted 
pressures to change this classic relationship between academic 
institutions and the programs they develop to serve their 
clienteles* 

fn an environment marked by declining enrollments and 
Hscal stringency, however, the academic community is in- 
creasingly awaie of legitimate reasons for external interest in 
their programming policies and decisions. 'Hiis awareness 
raises two basic questions: What can be done to develop a 
better understanding of academic programming and how can 
the tradiuonaf principle of leaving academic programming 
decisions to the academic community be preserved? 

The study on which this report is based begaVi with the:;e 
questions. Although the methodology was developed in one 
state, it is adaptable to institutions jn any state or region faced 
with similar circumstances. The ubiquitous issue of program 
duplication — whether wasteful or necessary — was central to 
this inquiry. Four m^or emphases evolved from this issue and 
concentrated on the need for availability, supply characten'stics^ 
and possible oversupply of academi'^. programs. 

Funded by two national and one regional foundation, this 
project was sponsored by the state's voluntary association of 
colleges and universities in cooperation with the state's deg:ee- 
grantjng proprietary schools. It was commissioned by the state 
board of education- This broad t)ase of involvement is reflected 
in the scope of the project, whicK included the study of some 
5000 academic prognuns, at all degree levels, in all of the 
state's public and private collegiate institutions and degree- 
granting proprietary schools. The high level of inierinstitu- 
tjonal cooperation represented in the initial sponsorship and 
subsequent participation was essential to the success of the 
project, but, nevertheless, could be regarded as something of a 
political miracle in itself. 

Methodology 

The state of the art in the study of academic programming 
may be divided into threw broad phases: <a) preparing a state- 
wide (or system-wide) inventory of degrce program offerings, 
using the Higher Education General Ihfocmation Survey vHGQtS) 
or similar classification^ (b) conducting a systematic pr&granr 
review of categories of piograms» such as tlv&se at the doctoral 
level cr in the health professions; and (e) analyzing the state^ 
wide ''ecology of degree opportunities/' including program 
characteristics, iiistitutional settings^ and demographic and 



societal factors such as population density and student and 
manpower demand. 

A number of states^ but by no means alh regularly prepare 
an updated inventofy of their degree programs (Phase I). 
Other states are in the process of conducting program reviews' 
to assist with decisions about existing or projected programs 
(Phase 2). This paper presents a beginning model for Phase 3, 
based on a 15-month analysis of academic programming in a 
large eastern state. 

The research design rests on a series of assumptions and 
value premises, including those related to acce:is, diversity, 
and institutional initiative for the wise use of scarce resources. 
The basic technical arsumptions are that (a) a specific degree 
program at a specific institution is the unit of inquhy and that 
(b) the description of this degree program unit must include its 
relation to all programs with the same HEGfS classification 
and degree level located at institutions within a defined geo- 
graphic radius. / 

Thus, each computerized unit record, described one aca- 
demic degree, program in its institutional setting. However 
the unit record ako included information about any pairs of 
pipgnims of which the initial protgram constituted one member. 
Programs were considered to be geographically pair^ if they 
existed within 30 miles of each other at the associate level, 
within 50 miles at the baccalaureate an^ master's levels, and 
anywhere in the state at the first professional and doctoral 
levels. 

Part of each unit record was the value for an index of 
geographic coexistence. This index was developed to reflect 
the level of geographic program duplication U>c each of the 
programs included in the study. To calculate this value, each 
member of a pair of programs was assigned half (0.5) of the 
pair credit designated for each pair. Thus^ if a baccalaureate 
degree program in economics at Institution A were within 30 
miles of four other such programs (at Institutions B, C, D and 
£), the unit record for the program at Institution A would show 
a pair credit of 2A or 0.5 of the pair credit for each of the 
pairs: A—Bf A—Cf A— and A— E. in contrast, the eco- 
nomics degree program at Institution B might be a member of 
only one pair (A — B), in which case its unit record would 
show a pair credit of only 0.3. The individual program has its 
own Index of geographic coexistence, which is the sum of Its 
pair credit 

The index ofgcogjraphic coexistence is the number of pair 
credits per program, for any program or group of progmms 
under consideration. The pair credits may be aggregated (from 
the program unit records) to show the h:vcl of geographic 
coexistence for various categories (such as degree level, 
HEOIS ciassiricatk>n» type of institution, or educational plan- 
ning region) into which programs may be grouped. F6r pfpgiams 
grouped according to any single category, or combination of 
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catcgoriest an indCA of geogiaphic coexistence <paircrcdits per 
progr^) may be obtained from the unit reconls of ihe con- 
&utuent progmms. Such aggregated inrormation thiovvs instant 
Jighl on such questions as whether there is more geographic 
duplication at the associate or baccalaureate level in the pro- 
prietary schools than in community colleges, or whether Ihe 
social sciences have more duplication than the physical sciences. 

The unit records for all programs in the study contained a 
limited anKunt of information, while Ihe unit records tor the 
paired programs contained a considerably expanded set A data 
items. 

Unit [ccordst for all degree programs in the study* m- 
cluded a number of data items obtained by the project staff 
from state and federal documents (e.g.. the annual HEGIS 
reports) or from other sources (e.g. » aspeciai manpower study) 
rather than directly from the institutions Ihcmselves. Examples 
of such items were number and sex of program g^^uatest 
tuition and fees, opening fall enrollment for Ihe institutiont 
relattye adequacy of manpower demand for Ihe program's 
giaduatesi, the progiam*s KEG1S classification, latitude and 
longitude readii^s (for determining pairing), segntent type 
of institution in which Ihe program was offeredt county and 
county populationt educational planning regiont and so On. 
Tv/o other indices, also if^ludcd for all degree progiams. 
were the index of graduate production (av^pge graduates per 
program) and ^c index of availability (programs per adult 
population) and a manpower demand indicator (Ihe relation- 
ship betweeii projected progr^ graduates and projected job 
possibilities). 

For progr^s which were paired, other data items and 
information for three more indices were requested directly 
frcm Ihe in£titutions by nk^ans of a 44-item questionnaire sent 
to :hc chief executive offieers by the project staff. The ques- 
tionnaire included items about program objectives and char- 
acteridics, institutional setting* admission requirements, faculty 
load and compensation, information about program majorsi 
credit distribution, instructional eharacteristicSt degrees con- 
ferred, and so On. 

Academic progr^s which were paired on the basis of 
geographic proximity might, in fact, be quite different when 
examined in terms of these and other descriptors. An index of 
program similarity was developed based on a comparison of 
the two programs in caeh pair relationship over the entire rang^ 
of collected data items (program descriptors). 

For every pair of programs, a difference score was calcu- 
lated for each data item. The difference score was defined as 
the difference between Ihe values shown by the two programs 
for the particular data item. A distribution was then made of 
these difference scores — for this one data item, for all pro- 
grams statewide with the same degree and KEGIS classifica- 
tion. Whether the members of any one pair of programs were 
to be regarded as ""matched" (similar^on that variable depeirdcd 
on Ihe relative position of their difference score in Ihe state- 
wide distribution of difference scores noted above. More 
specifically, the pair of programs was regarded as matched^ 
for a given data item — tf il^ difference score fell at or bcIow 
the median in the statewide distribution of difference scores for 
this particular KEGtS classification and degree level. Just as 
the two members of a program pair shared the one pair credit 
(each receiving Q.5 pair credit for its unit record), so the two 
mennbcrs of a pair matching on a given data item shared the 
match credit (each receiving half of the match credit fc^ its 
re&pcctive unit record). Match credit, then, was assigned to a 
program whenever the difference score exhibited by the pro- 
gram pair for a data item fell at or below the median on the 
statewide diftribution of difference scores for this KEGIS 
classification and degree. (Match credit differed slightly for 



pairs falling at, as compared mih below, the median dif 
ference score.) From this accumulation of match crcdttt an 
index of similarity was developed for each paired program. 
Although Oversimplified for this brief prcsentation, the index 
of similarity for a program may be expressed as a ratio of 
program niateh eredit to program pair credit. 

Although the project steering committee (representative 
of the several segments or types of institutions) discussed a 
number of times the question of relative importance among the 
vanous program descriptors* no conclusions were reached on 
this issue. In fact* such a judgement was regarded by some as 
being within institutional prerogative. For this and other reasons 
of time and resources* the data items used for the index of 
similarity were weighted equally. In any future applications of 
this model, whether in the original state or etsewherct dif 
ferential weighting of data items will likely by reconsidered, 
we recommend this. Also, subsets of Ihe index of similarity 
(ag^in with appropriate weighting) could be developed for 
clusters of data items, such as those describing admission 
requirements of the paired programs* students servtdt cost 
factors* and so on. 

Never to be forgotten, however, arc the political realties 
of Ihe difference between dcjiiable and feasible program de- 
scripiorst including their weighting. Particularly in an eia of 
in^ttitutional fragtlityt any study of academic programming^ 
voluntary or prescribed — must operate int but not be over- 
whelmed by, this envi ronment in wh ich program research 
must go On. ^ 

From the questionnaire and other information sources* 
three additional indices were developed for the unit records of 
paired programs. Two described student demand* and a third 
was a measure of Ihe institutional dependence on Ihe program. 
They were (a) an index of student demand for program (ex- 
|/iessed as a latto of the applicants for a particular program to 
the applicants for all paired programs in all disciplines statewide 
at the same degree^ level), (b> an index of student demand for 
location (expressed as a ratio of the applicants for a particular 
program to the applicants for all paired programs within the 
same KEGIS classification and degree level statewide), and 
(c) an index of institutional need or dependence On the program 
(expressed as a ratio of the fuU-tinw; equivalent (FTE) majors 
in a paired program to the institution's total PTE opening fall 
enrollment in Ihe base year). 

The unit record format facilitated the aggregating of data 
to highlighT jielationships between and among categories into 
which programs were grouped, such as degree level, major (2 
digit) KEGIS classification, segment or institutional type* 
educational planning region, and manpower demand classifi- 
cation. In addition* within degfcc levels, Ihe programs were 
ranked in terms of their respective index values for the indices 
listed carliert and the top and bottom quartiles of these rank 
dtstributrons were then examined in relation to the categories 
notedi such as major KEGIS classification. 

Neither the research design nor Ihe unit fccord format arc 
dependent on specific data items* with Ihe possible execplion 
of the latitude and longitude readings, which were fumished 
On contract by the U.S Department of Cbmnterce. This in- 
formation about institutional location is necessary in order to 
construct a distance matrix, which is the basis for determining 
program pairs. As noted above, only programs which were 
paired (that is, were within the defined geographic distance 
from a program with the same KEGIS classification and degree 
level) were further examined for program similarity. As with 
the research design and ihe unit record formatt however, the 
determination of similarity between two nearby programs is 
not dependent on specific data items. 

Also eanied out as part of this stut^ was a beginning 
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model for state-to-state comp^orts of academic programming, 
based On nationally available data. Tapes ffom the National 
Center for Education Statistics (NC£5) providctl the data for a 
pilot companson'of progiams in whieh degrees were awarded 
in three contiguous states over a 3-year penod. Programs for 
eaeh state were displayed by HEG1S classteation and degree 
level, along with the number of prognims in each classifieation 
per aduJt pcpulatton unit. As another indication of the potential 
for interinstitutfonal eoopetation, the staff of the project re- 
ceived eTccellent cooperation from offteials in both of these 
neighboring states as the comparative data were beii^ eompilcd 
and reviewed* 

Findings 

A study of this magnitude, describing over^,000 academie 
programs* at five degree levels, in ten edueational planning 
regions, offered by over 200 {K>stsccondary institutions of 
eight different types, obviously produced myriad findings in 
response to research questions about the need for, as well as 
the fivailability^ supply charaeteristics, and possible oversupply 
of, degree prc^rams in one of the nmion's larger states. Many 
of these findings are summanzed in the text tables of the staff 
tcchnieal report* while others aie in the eTctensive computer 
files. 

In time» the staff technical report and specific findings 
may be shared with other states. As thisjmpcr is being written* 
however, these findings — as distinet from the research design 
— are privileged information under the auspiccsof the voluntary 
association of institutions whieh sponsored the study and ob- 
tained funds for its support. 

Basically, the projeet provided the institutions with a data 
tesdurce describing the entire state's postsecondary programs. 
Data appearing in almost 200 te^ct tables and several appendices 
of the staff teehnical report give a factual framework through 
which institutional and other leadership may view Orograms in 
a conteTct of institutional or interinstitutional planning and 
deeision making. The unit record for each program stores a 
standardized ^ of infonnation about the prognun itself, the 
students served, the institutioifal setting, and the several in- 
dices compiled during the course of the study. Values for each 
unit record may be aggregated (across programs) and eTcamined 
in relation to 43Very other unit record item! Also, these program 
descriptors may be updated, supplemented, deleted, or weighted 
without alteriiig the format of this basic data resource. The 
sponsoring voluntary association of colleges and Universities is 
developing guidelines and suggestions for the use of these 
data* 

A few general findings may be shared at this time. n^Iated 
to response patterns and kinds of profiles devebpcd from the 
data eompilcd and the analytical model applied. 

One of the most important findings, in our judgment, is 
the evidence from thisstudy that a state's entire community of 
postsccondaiy institutions— public, private, proprietary, two- 
ycar» four-year, university — will indeed work together in a 
voluntarystudy of their academic programming if they believe 
the undertaking is worthwhile in tenns of their own goals and 
values. Over three-quarters of the institutions to whom qucs^ 
t! on n aires were sent returned One or more with some.ifnotaJI. 
usable responses. ApproTcimatcly the same percentage of retum 
held for the questionnaires themselves. 

Clearpfofiles emerged from the model with respect to the 
aeademie programs found to be paired geographieally on such 
program specific descriptors as graduate prodtJction and man- 
power demand. Similar descriptive profiles also emerged for 
the eight educational segments (types of institutions) !n terms 
of proportion of the total number of programs offered in the 
state, typc^of programs available (HEG1S classifications), and 



representation of progiams at the five degree levels. A portion 
of the findings came as something of a surprise to some 
observers— for example, the faet that associate level programs 
wem offered not Only by the community and junior eolleges 
and proprietary schools, but by every one of the eight types of 
institutions in the state. 

Discussion 

By concentrating On the pair relationship of degree pro- 
grams, the study's research design provided not Only a mech- 
anism for measuring eoeTcistenee but also a procedure for 
selecting programs to be further CTcamtned for evidence of 
similarity beyond mere geographic coe^cistence or duplication. 
The descriptors by whieh two programs are adjudged to be 
similar or dissimilar are crueial. Relatively few program de^ 
scriptors per se, as compared with institutional descriptors 
from which program descriptors may be derived, are available 
in Cedeial importing forms such as the HHGIS surveys. The 
development of standard program descriptors, as a regular part 
of state and federal information gathering, is eneouraged if 
otherjurisdictionsare to cany out studies of their Own academic 
programming without costly and time-consuming ad hoc data 
gathering. This would also faeilitate interstate cooperation in 
the study of aeademie pro;jramming» especially important 
where population centers, and thus educational service areas, 
span two or more states. As noted previously, a beginning was 
made in this study when the academie programming by HEGIS 
elassifi cation and degree levels was compared for three ad- 
jacent states. Data used for this eomparison were obtained 
directly from the annual HEGIS degrees awarded tapes, which 
are public information. An CTcpansion of nationally available 
program data would pcmiit other comparisons of value in 
making decisions about academie programming. 

Beyond the question of program data - ailability is the 
matter of the relative importance of program descriptors. The 
question beeomes* What is important, and how important, in 
assessing the similarity of programs which are ge<^phieally 
duplicative? The answers ait crtieial in responding to still 
another question: When Is program duplication necessary and 
when it is wasteful? Refining academic program descriptors and 
assigning weights to them arc ncTct steps in advancing the 
methodology used in this study. The icseaich design includes 
a systematic procedure for assessing similarity between two 
geographieally paired programs. TIte results^ however are 
obviously dependent on the eongruence of those program 
descriptors used with those judged to be essential and appro- 
priate by the individuals utilizing the information for decision 
making. 

Turning to data analysis^ it became apparent early in this 
stage of the study that the scvera^ indices were espceially 
valuable in drawing profiles of programs (or categories of 
programs) when they were used not in isolation but jn com- 
bination- For CTcampie. programs showing high levels of geo- 
graphie duplieation, availabilNy. similarity, graduate produc- 
tion» and institutional need or dependence but low levels of 
student demand and inadequate manpower demand present ^ 
distinct program profile which may suggest attention by insti- 
tutional planners. A program profile showing the reverse for 
Only one or two of these indices presents a rather different 
pieture. In either ca^c. indcTc pfofiles may be used for eTcceptton 
reporting to the instjmtionaJ leadership, not fOr summary de- 
cisions but as a signal for the eTc ami nation of otherm formation 
in the program's unit rceord or elsewhere. 

When this project began, then* were models available for 
the first and second phases in the study of academic program- 
ming (preparing statewide program inventories and condueting 
program reviews), but no model for the third phase (analy2ing 
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the !ktatewidc ecology of oppoituitities). A protolypc base should be citcoumgiitg cvidcitce for ihose who believe 

thtrd-phasc model has now been developed with a data base that '*the tradidoital priitciplc of leaving academic programintitg 

dcscifbbig one state's programs^ their relationships to one decisions lo the academic community should be preserved." 

another, and (o their institutional and societal settings^ The Replication and lefincment of this approach to the study of 

fact that a substantial proportion of the institutions participated academic programming by our colleagues in other states and 

in this voluntary study of their academic programming and are regions will be welcomed, 
now working together on ways to maikt the best use of this data 
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As the lifelong learner concept becomtis aicallty in our 
society, Institutions are finding that their roles are changing 
dramatically Even though education remains our business, it 
IS n^ longer simply the traditional student who demands our 
attention. Where the customary student is located conveniently 
and neatly within the four walls of the secondary school, this 
new ntarket is sprc^ad across the community, the state* and 
even the region, in households, businesses, and churches. 
With the advent of this new student population, the ability to 
provide accurate and oompiete data on both the new clientele 
and the noicntial market becomes a necessity. These data could 
be maintained by the institntional research office, li will be- 
come increasingly important for institntional researchers to be 
knowledgeable of the scope of lifelong learning in higher 
education as well as the division on their campuses. 

The terms lifelong learning, adult education, continuing 
education, and recurrent education all suffer from a lack of 
clarity as they are used in higher education today. The Ohio 
Citizens* Task Force on Higher Education defined continuing 
edn cation/lifelong learning as *'a term synonymous with or 
encompassing, adnlt education, comnnnnity and public service 
programs/' (Siccero, 1976, p. 54.) For our purposes, we 
define continuing education students as those people who no 
longer identify their primary roles to be that of stndem and 
who are involved in non-credit programs and/or credit non- 
degree-granting programs. 

The adult learner popniation has had quite an impact on 
higher education. According to Gravlieh in the Wall Street 
Journal (January 24, 1977), 34% of total college enrollments 
m 1975 were adults. This represented a hu^ jump from 1 .7 
million adults in 1970 to 3.7 mDlion in 1975. By 1980, the 
Census Bureau estimates that adults could htm 40% of the 
total- Viewed another way- one of evety ten college students is 
over age thirty-five. (Van Atstyne and Coldren, 1977, p. 9). 

Due to the change of student populatton, about one-third 
0^ the 3000 colleges and universities in the United States are 
offering some kindofaduh education, which represents a 10% 
increase since 1970. This trend will undoubtedfy continue as 
our population becomes older. It is estimated that by the year 
2Q0O» there will be 80% more adults ogcd thirty-five to forty- 
four than at present, and the number of people over fifty-five 
will be up by 27%. (Gravlieh, 1977) 

In' looking at continuing education in the last quarter of 
the twentieth century, we an; foeusii^ on three primaiy groups: 
(a) professional people who need additional education lo meet 
licensing requirements, (b) individuals who need to upgrade 
their skills for their present job orforpiospcctive employment 
through enrollment in credit and non-credit courscs^and finally, 
(e) persons who want personal enrichment courses. Although 
these categories are not all-inclusivei they do represent the 
scofic of continuing education today. Although some latitude 
exists^ there must be a time at which decisions about iKogram 
direction occur. Hesbucgh^ Miller, and Wlmnon (1974) made 



the point that, given this lack of resources to provioe all things 
to all people, . . . research is needed, both basic and 
applied, and too few resources exist with which to cany out 
the work" (p. 25). 

Stephen R. Graubard (1974) follows this thought by 
saying that. Higher educational institutions cannot wait 
for the demand to manifest itself and then respond by 
offering speeifie courses (probably in the evening). They 
ought, rather, to engage in systematic studies of what 
adults in a society like our own need to know, or would 
profit from knowing, and seek to maice diese things 
available to ever larger groups during the^day^ at night, 
on weekends^ in the summer, and at many convenient 
sites, (p. 10) 

Many of the problems in deter*.. ining demand can be at- 
tributed \o three factors: (a) the lack of knowledge among the 
cltentete as to their needs and wants, (b) the lack of expertise/ 
time within continuing education divisions to perform such 
surveys; and finally, (e) die lack of funds within a university to 
hire the external expertise needed to gather essential data. 
Given these problem, areas, institudonal researchers may play 
a vital role in assisting the continuing education division in 
reaching the needs of its constituents. It is very difficult to 
have a long-term, successful program without data on the 
potential market and on the success of current courses^ 

Many areas of research concerning adnlt learners exist 
and need to be examined. Locating the marketof adult learners 
is one. Cunently. those individu^ds who participate in adnlt 
education programs are those "under age forty, relatively 
afflLsnt, intemally motivated, employed as piofcssionals or 
managers, iind well-educated.'* (Nolfi, 1976, p. 130} What 
about those who are not involved in the continuing education/ 
tifelong learning progtams? These people must be identified 
ard their needs defined. Why have they not participated? Is 
the reason financial, fear, uncertainty? Once die total maiket 
has been identified^ its needs isolated^ and the results presented 
to the eondnuing education division, programs can be designed 
to overcome the current barriers, Using data provided by our 
offices, the institutions can attempt to mc^t the needs of this 
population. 

As a rcsult of the intense competition and the proven 
demand, marketing rcscarclt must be conducted to eliminate 
some of the unknowns in continuing education divisions. Thus 
arises the need for an instiuitional research office to assist this 
unit in performing a needs assessment for the community. 
Institutional research is much more than a storehouse of insti* 
tutional informaiion. It is. in fact^ a field that is responsive and 
skilled. The expertise should be available within the office to 
serve an information support unit to the institution and. 
thusi its assistant to the cnndnuing education division. Phillip 
Kotler's (1976. pp. 54-72) work on applying marketing theory 
to college admissions for traditional students can, in part» be 
applied to the no n traditional Student as wclL 
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According to Kotlcf ^ the college marketing procC!>& com 
priikCik ^vcn ba^tc dctivities, mstitutionaJ positioning^ pon 
folio planning* applicant development* applicant evaluation 
and noiification* rccmitment* effon evaluation* coltege im^ 
piovement planning* and alumni lo>alt> development. Although 
tbiik marketing process is designed for the traditional student 
market per se, it doe^ offer a point at Mvhich institutional 
research can emergi; as a viable contributor to the continuing 
edueation division. 

Adapting Kotler's thesis to institutional fesearch* we 
ikhould be able to address the following marketing functions m 
cujijunction Mvith the continuing education division* within its 
defined fealm of fesponsibility: 

Imntutianal posiUomng — This function involves as^ssing 
the college's eurrent position in the market in fetation to 
competing colleges (or other organizations)* identifying posi- 
tion alternatives in felatioo to the educational and competitive 
tfends; ehoosing the position u^ith the gfeatest long-mn op- 
ponunit>, and finalJ>* choosing a strategy that will help the 
institution attain the market position tn a feasonable length of 
time. This is the initial stage of the institutional research 
office's involvement in the marketing of a continuing educa 
tion division. Primarily* it involves assessing the overall pht- 
Josophy of having sueh a unit* given the climate of the market- 
place. 

Portfolio plonmng—lMi^ function involves determining 
the typc& of courses to be offefed eonsidenng the needs and 
desires of the market. The institutional rcseareh ofTice could 
assist in this funetion through the pfeparation and implementa- 
tion of In-depth surveys of the market and subsequent analyses 
of the data. This information m\\ be used as continuing eduea- 
tion divisions make decisions on the programs to be offered* 
expanded* or terminated, 

Appllcartt developmertt—This funetion hinges* in part* on 
the work of both the preceding oontponents. The institutional 
researeh ofTiee would in effect isolate potential eandidates for 
a continuing education eoorse. This eonld be a coniaet wtlh 
accfedamg agencies throughout ihe state for possible profes 
atonal development activities for their members and perhaps ^ 
sample survey pi the local population to determine eoursc and 
Jeaming needs of individuals and eorporations, Jt u^ould be 
neeessary to bu^Jd a need neiu^ofk in order for businesses to 
use the institutio*^ ^ continuing edueation division rather than 
in house personnel. These functions Mvould give the eontinuing 
edueation division some of the data it needs to determine 
future demand as well as to evaluate euncnt offerings. The 
institutional feseatcher could assist the institution at laige by 
being aware of the potential market that exists and the com 
plexion of this new elientele. 

As institutions expand their philosophies to include the 
adult leamersand what ihcy feprescnt in our changing society* 
institutional research offices can provide much-nccdcd services 
to the institution and eontinuing education offices. One area 
whieh can be explofed involves those individuals retuming to 
the campus for continuing professional education. Surveying 
the businesses in a particular area or fegion can determine if 
the potential market for promoting more continuing professional 
education courses is what the business community neecb. 

Another service that institutional fesearch offices could 
provide to the continuing education function involves a state 
wide or regional e/fort. In conjunction with other offices in a 
given afea* they should determine all adult edueation that is 
OCeurring* whether it be university* college* publie* private* 
corporate* or govemmental. This endeavor eoincidcs with 
Siccefo ^ (1976) recommendation ihat alJ institutions within a 
state — Universities* eolleges* technical institutes* publie school 



systems* private c^lleg^s* and school systems— should have a 
i^Iear definition of what continuing education is all about and 
what IS to be attempted to meet the nc^s of continuing 
edueation, 

A funher position of suppon for continuing education by 
institutional research is to build a strong ca^e for increased 
institutional* Mate* and federal suppon for the adult learner. 
Since much of this population attends classes on a part time 
basis* it has been denied financial aid* proper counseling* and 
adequate student services. Yet these students comprise a great 
port* of the populace being educated today. As decision 
maic*^ *n all facets of education are provided data which show 
the dramatie impaet Jifelong learning is having on educational 
institutions* the) wiU acknowledge the need to include thes? 
students in budget priorities, 

Jn considering the more global effects of continuing t^du- 
cation» it IS necessary* then* to discuss the Matus and the future 
of the continuing education unit (CEU), 

Accurate and complete records on students* including the 
awarding of the CEU* are necessary. While the CEU does not 
yet hold the aCeep^d status of the credit hour* it b* in fact, a 
recognized measure of participation. (The Southem Associa- 
tion of Colleges aad Schools has led the way here,) The 
National Task Force definition is* "One eontinuing education 
unit (CEU) is ten contact hours of participation in an organized 
continuing education experience under responsible sponsor- 
ship* capable dtreetion^ and qualified instn;ctton** (SACS* 
1973* p, 2), According to Harrington (1977): 

The eontinuing edueation unit is used as the oasis for 
award of certificates or to figure full-time equivalent 
enrollments in requesting legislative appropriations. The 
eontinuing ^education unit can also provide a basis for 
turning non-credit into credit, via leaming-thm-life 
experience calculations or by weighing the value of 
courses taken outside higher education, (p, 87) 

Given the imponance of this measurement now and po- 
tential uses for it in the future* it is necessar> that thorough and 
complete record -keeping devices be established. Data should 
be kept on non-credit and credit continuing edueation studems 
that IS similar to the data kept on traditional credit students. 
This would involve establishing data files on each student* 
with information on eontin uing edueation units earned as well 
as demographic characteristics* to be used in the ways traditional 
student information is used. Also* it would be used for basic stu- 
dent data for nfiarketing surveys* federal and state leports* etc. The 
institutional research ofTice eould aid in the establishment of 
such a system jn coordination with other units (i,e.f eontinuing 
edueation division* registrar* etc.*), Jt is necessary that the 
institutional research office have input into the system in order 
to accommodate future reporting rcquirctf^jCnts at the state and 
federal levels. Many programs* both in higher edoi^tion insti 
tiittons and in other origan izations* know little of this new 
clientele. As a result* it is often difficult* if not impossible, to 
know geographical areas where individuals arc unaware of the 
program or where certain needs are not being addressed. The 
instttutional research ofTiee might function as ihe area on 
campus that analyzes the data from the continuing edueation 
division to determine* on the one hand* the courses that are in 
the most demand and, on the other, the descriptive variables 
on the population attending so as to isolate the groups not 
attending. 

We have prepared summaries of the eontinuing education 
programs of our lespcctive institutions which demonstrate 
what is currently being done in each and the needs ihat cAist in 
each. 
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Spring Hill College 

Spnng Hill College isapHvate* liberal arts college under 
the sponsorship of the Jesuit Fathers of the New Orleans 
Province of the Society of Jesus. Within the last two years* the 
College has initialed a program of continuing education. Al- 
though at this point the focus is non-credit and. primarilyt 
personal enrichment eourses* there are plans for a iiegree^ 
granting addition if resources and eommitnfient exist for de- 
veiopntent. 

The institution is located in Mobile, Alabama with an 
SMSA (Standard ^Metropolitan Statistical Area) population of 
appro xtmately 400,000 The eollege*s enrollment is more than 

and It is traditional in its programs. Within the SMSA of 
Mobile are a ehurch- related liberal arts eollege; a publie 
university with graduate and first professional programs, several 
two-year junior colleges; as well as trade/leehnieal schools. 
The eompetition offered by these postseeondary institutions, 
eombined with the entrance Into the market of ehurehes and 
eonimunity »>chools» makes knowing the needs of our eonsti- 
tiientj; essential to a continued successful operation. 

Sinee its inception in 197^* the Lifelong Learning Prograin 
has shown steady growth. Although the profits have increased 
considerably dunng this period, the important point is that 
numbers of clients have increased. Considering thenewnessot 
the program, the indication is that mail.ngs, word*of-nr.outh 
information^ and media advertisements are effective and that 
the program's course offerings are desirable. 

The program was built upon a revenue-producing mamlate. 
At pre'vent, money is not recycled into the program to subsidize 
small courses Thcreforct courses that do not register a certain 
number of students are cancelled Courses are offered because 
of three main considerations: (a) proposal by person who 
desires to teach a certain course, (b) substantial desire of a 
group of people to have a certain course, (c) hit-and-miss 
suggestions from other schools or from individuals. Although 
these three reasons represent no systemized ivay of offering 
courses, they have proven effective for Spring Hill thus far. 
These methods have proven ridequatc with sueh a young pro- 
gram, but if the Lifelong Learning Division is to expand its 
non^eredit area and move into the eredit realm, more valid 
information must be available to course planners. 

Given this situation, what should an institution like Spring 
Hill do to expand its continuing education program, given very 
limited resources and n- paid staff? Certainly, hopes are that 
money will bc provided by an outside fiinding source to do a 
sophisticated marketing survey, pay a portion of the director's 
salary, and allow for expansion into eredit areas. However, if 
money is not made available, what then? Surrender? Never! 
There is enoi^h expertise within most college units to addresss 
some of the proul^ms mentioned. In approaching a similar 
situation at a college like Spring Hill, what kinds of support 
can an institutional research office offer? The following repre- 
sent specific ways to address some of the problems. 

J Within your geographic area, isolate institutions that 
are competitive in terms of the courses being offered and 
regional proximity of their campuses to yours. (Course listings 
are rcadiJy available ) From this information, your areas of 
specially can be identified as weJJ as types of courses not 
offered* 

2 ConsUtiet a questionnaire to be sent to businesses 
within the area to obtain the following infbnnation. 

a Amount of continuing education required of their 
employees in both the technical and managerial 
categories 
b« Types of education needed 



c. Availability of such training internal and external 
to the company. 

These data would help to determine if the institution 
and local businesses could coordinate efforts. 

3. Determine from addresses of previous enrollecs the 
areas of the community from which ihey are drawn. From this, 
random addresses from the home census tract can be put on the 
maiJing list to receive information on the program. There is 
probably untapped interest in that particular area. 

4. Prepare a brief marketing telephone questionnaire to 
be administered by sele<:tcd Mudcnts to a random sample 
^^ithtn selected census tracts. CcnMJS tracts vjould. at first, be 
those v^ithin a ten-mile radius of the ^hool. Sefccled informa- 
tton to be asked would ber 

a. Knowledge of the program from media, fricnd'>, 
brochure 

b. Types of non-credit courses of most interest — 
personal enrichment, professional skills* profes- 
sional update 

e. Willingness to attend yoiir institution for eredit or 
non-credit 

d. Interest m obtaining a degree on weekends and at 
night 

e. Cost considerations. 

5. Build a profile on current students to be aware oi 
characteristics of persons attending. 

Although this represents a peripheral view of the total 
needs, it docs provideapoint at v^hiehan institutional research 
office can offer much-needed assistance. The institutional re- 
search office should assist in maintaining continuing education 
units in a systemized way, either in a manual or computerized 
form. If demographic data is not being kept, iccord cards 
should be composed. Spring Hill has an accurate manual 
system of maintaining records, but many schools may not. 

With their ability to be flexiblct there is a great future for 
continuing education programs in the small private schools of 
our age, given proper support, accurate information, and able 
leadership. With the expertise institutional researchers have 
available, there is an opportunity to make a significant contn- 
bution. 

University of Alabama in Birmingham 

The University of Alabama in Birmingham (UAB) began 
as an extension of the University of Alabama in Tuscaloosa m 
1936. It was established as a separate campus of The University 
of Alabama System in l%6. UAB is located in the heart of 
Alabama's most highly populated area, with an SMSA popu- 
lation of approximately 800,000. 

Hence, it is a relatively young university, vjith its rote and 
scope dedicated to the concept of education for an urban 
population. Its 12,000 students are primarily commuters, with 
almost '40% attending part-time and/of in the evening. UAB's 
commitment to the adult learner has existed since its inception. 
Unlike many institutions, adult and evening students who an: 
taking classes at UAB have many of the same services asjlo 
the day students. 

The Division of Special Studies is the unit within the 
university which manages the non-credit and nontraditional 
credit courses for University College, the non-medieai portion 
of UAB. Special Studies provides students with non traditional 
modes of learning in eoopenation with tlic appropriate academic 
unit. Although there is no direct involvement at UAB by the 
institutional research office, wiiat is being done there could 
serve r*s an example for schools whose continuing education 
division needs assistance. 

Two years ago, the new director of special studies initbtcd 
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a comprehensive campaign to become more knowledgeable of 
special studies' clients, their needs, and their awareness or 
special studies' prpgrams. An intensive marketing effort was 
begun using direct mail, the tit^diat cost/benefit analyses* and 
performance evaluations. A continuing educatioi: .nformation 
system (CEIS) was established ^ keep machine-readable data 
on clients of special studies. Enrollment in ROn-credit courses 
has doubled in the last year. 

To initiate the marketing effort, the director used the , 
talents of individuals io ihe graduate program of the School of 
Business. First, a marketing plan w^ designed which pin- 
pointed the competition and their courses as well as their 
strengths and weaknesses. The marketing plan also specified 
the life-cycle stages or various programs being offered through 
special studies to aid in the timing of future program offerings 
and discontinuations. 

Second, another marketing research graduate student sur- 
veyed a random sample orUAB's market a^a to determine the 
feasibility of certain course offerings and certain pricing levels. 
Several of the programs which had ^ success indk:ator as 
a result of this survey have subsequently been oflfered and. as 
predicted, have been popular courses. 

The philosophy of special studies is to be as responsive to 
the needs of the community as possible. Thus. If a group 
desires a particular course offering, special studies will attempt 
to locate an instructor and will liandle the logistics of the 
course. Provided sufficient enrollment occurs to pay for the 
instructional and administrative expenses* the course is then 
offered. This responsiveness is not the result of any market 
reseaitht hrowever. 

To use questk>nn aires 'and interviews on what piarticular 
courses people desire ibises a <juestion about the validity of 
such surveys due to the biases that originate In the survey 
intniment. For example* to ask If an individual would take 
* course X, Y, or Z ttiunedlatcly constrains the courses to be 
considered. YeCt most people are limited in their attempts to 
create or describe courses they want or need. Deteimlning 
what courses should be offered Is perhaps more appropriately 
based on what the long-term needs of society are. And. as 
sociologists can attest* this information Is not readily attained. 
Thus, special stndies' current methods of est^llshing courses 
through specific requests* in combination with using what has 
been successful in other continuing education programs. Is 
f^dequate until a long-term needs^assessment instrument is 
designed. 

Concurrent with offering desirable courses is the actual 
selling of die courses. Special studies tnarkets Its courses using 
a mixture of public service announcements on radio and tele- 
vision, print campaigns in the local newspapers, and direct 
mail of its brochures and bulletins. 

So that a partial measure of effectiveness of ttie different 
media forms is atlainablct different telephone numbers arc 
nsed in each formof media* A tally of the number of inquiries 
received on each telephone line Is kept during the weeik fol- 
lowing public exposure to the marketing vehicle. The results 
of the tally when viewed as a percent response of total viewers 
(television) or total recipients (brochures) aid in making de- 
cisions to change the advertising mix. 

After the Birmingham market was examined and a mar- 
keting plan devisedt the next step was the purging of the 
(nailing list. Two years ago. over 14,000 brochures of courses 
were mailed each quarter. The names on that mailing list 
comprised all people who had ever taken nOn-credit courses. 
Those who had taJccn two or more courses received two or 
more brochures. Due to the complexities of eliminating dupli- 
cations, many individuals were receiving several brochures 



each quarter. The director decidt ' that a manual purge of the 
list was mandatory; this was done <ldring the following quarter. 
People whose names were on the list solely because of their 
membership in a club or organization were eliminated since 
there was no evidence that these people would mote likely 
participate In nOn -credit courses than any other segment of the 
population. To update old addresses or to eliminate those 
which the post office designated as "addressee unknown*" 
postage-paid returns to sender were implemented. The effect 
of all this woHc was to eliminate some 10^000 names (and quite 
a few ineffective mailings) during the year. By spring of 1976, 
special studies was able to send these bulletins to 10.000 
additional homes. 

The direct mail campaign Is perhaps the most Interesting 
marketing device used. Each term* the course offerings are 
printed In a tastefully designed catalog. Since direct mail 
experts maintain that five mailings to an individual are to be 
anticipated before a sale is made* each name remains on the 
mailing list for a year before being removed. If that individual 
registers for a course during the year, he will not be removed 
until more than a year passes during which he does not register 
for a course. 

Since an analysis of the zip codes of previous course 
enrollees revealed certain areas that responded much mor^ 
heavily to non-credit offerings, a great portion of the extra 
I OtOOO brochures were sent to these areas. And a portion wns 
used in areas that had had little or no response in the past. The 
result of saturating zip codto has hetti to greatly increase 
registrations from those areas where registration had previously 
been high but to have little effect in the other areas. 

Ptess releases (written by special studies' stafi) provide 
free advertising vehicles for nOn-credlt conrses. Occasionally 
special feature articles appear in dte tkcwspapers about particular 
course offerings. This further exposes the Division of Special 
Studies to the public. 

^ost/beneflt analyses as well as break-even analyses are 
constructed each quarter to fnrther monitor the effectiveness of 
the maiiceting plans. Performance and course evaluations are 
nsed to improve the quality of courses. 

While the marketing aspect of special studies was being 
implemented* a computer-based system, the continuing educa- 
tion information system (CEIS). was begun. Upon the redesign 
of the regisu^tlon card» various information about each reg- 
istrant was computerized. In addition to die basic data of 
name, address, course* employer, etc.* other information is 
gathered which helps in building a profile of students. The 
spring 1977 profile, for example, depicts an averse age of 
32.0years» with an average educational level of 16.4 years (or 
males and 14.7 years for females. Through the CBIS. special 
studies can provide a transcript of CEU'seamed to any student* 
in addition to class rolls each quarter and other miscellaneous 
data. 

Even though special studies is utilizing many business^ 
oriented techniques and has a mass of data available about its 
clientelct the^director feels the need for more information. Due 
to the urban orientation of the University* he wants to offer 
courses that meet the needs of the elderly and of minorities. 
Enrollment of these two groups has not grown as rapidly as 
that of other segments of ttte population. How these two 
groups can be accessed i-^ the main problem^ facing special 
studies now. 

Summary 

The techniques used t)y the Division of Special Studies at 
UAB and t)y the Lifelong Learning Division at Spring Hill can 
be Implemented at any insthution with the help of institutional 
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researchers. Assumti^ we possess adequate iramli^^ we can 
help design surveys, analyze population patterns, advtse on 
direct mailti^s* and assist In the design of rcportii^ systems. 



What an excitii^ opportunity exists for us as the lifelong 
learner becomes reality 
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A MODEL FOR THE REVIEW AND 
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This paper describes a model for the 
mem of academic programs/ As cnroltmcnts and resources 
stabilise and then conliact in the l9SQs> program deletion wilJ 
become more imponant. Cunrieula wUI have to be streamlined 
for eost leduetion* increased flexibility, and decreased admin- 
istrative effort. Resources will also have to be roeyeled to 
supp6n new programming initiatives. 

Wc are aware of a number of program review and aban- 
donment efforts both through the literature (Benaeerraf, 1972; 
Gilfis and Muston, 1973; Milleu, 1973; and University of the 
StateofNewYork,(l973)andlhiotigh contacts with eolleagties. 
Otir general impression is that norke of these undertakings can 
be describetl ^ an unqualified success; in fact, the payoffs 
from most have not justified the faculty, staff> and adminis- 
trative effort expended on them. We beJieve this paper sup- 
plements this body of literature and experience m four ways: 

1. Most of the Processes just noted involve the review of 
alt of an institution's academie program. usuaJJy on a five-year 
eyeJe. In this paper, we suggest that noi all programs require 
in-depth review and thi^t the effort expended on program 
review ean be [educed substantially through the use of an 
initial screening process. Through this process, prpgrams which 
actually need in-depth review ^ identified and those which 
do not (the preponderance at most institutions) are dropped 
from further analysis. 

2. Most of the program review and abandonment pro- 
cedures we have examined focus on the assessment of quality 
cost benefits, notably difficult variables to measure. Although 
we do not omit quality considerations frc^ the procedure 
outlined in this paper, we emphasize the assessment of m:ukct 
demand for the program and program costs. 

3. Most of the literature with which we are familiar does 
not speak clearly or extensively about the complexities of 
program abandonment. Issues such as marginal cost and pro- 
gram interactions are not well defined. Thrs paper takes some 
tentative steps toward dealir^ with these issues. ' 

4. None of the papers at which wc have looked deals in 
depth with the problems of actually abandonir^ a program. 
This paper outlines the basic issues which should be considered 
as a program is phased out. 

fn the sections of the paper which follow, an existing set 
of techniques for phasing out weak products is adapted from 
business disciplines for use in higher education. After brief 
references to the major conceptual foundations in the discipline 
of marketing, the techniques are combined into a fou^stagc 
system for program abandonment. This system idcnliftes edu- 
eatjonal programs which are operating ineffectively and pro- 
vides for phasing out those which cannot be rehabiJitale^. 

Conceptual Foundations 

The idea of program review and abandonment is perhaps 
less difficnJt to accept if it is understood that most educational 
programs have u life cycle not nnlikc that of business products 
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and services. The concept of the product life cycle is well 
established in the business disciplines. (See. for example: 
Bell* 1972. p. 620* and Kotler* 1972. p. 429.) Although 
amplitude aiid duration vary widely among products, all have 
introduction, growth, maturity, and decline stages in common- 
It should ^ stressed th^t different marketing strategies are 
used in each stage of the life cycle. For example, declines are 
frequently reversed through such strategies as recyclir^ (i.e.. 
ptoduct adaptation to maintain current market levels) and 
taking-off (i^.. introduction of a product into new markets). 

The issue of prodt^ct evaluation has received limited, but 
nevertheless instmctive. attention in the marketing literature. 
In 1955, Kline noted the lack of attemion given declining 
products. He cited the im.^onance of reviewing all product 
lilies periodically in order to ei'Tinate the obsolete items and 
:o prevent effort from being diverted to products that arc low« 
volume and less profitable. Later, Hurst (1959) suggested ten 
criteria for product abandonment decision^ Berenson (1963) 
developed a comparative model for pitining a £et of candidate 
products. The model established two quantitative and three 
qualitative var/jbles« together with a weighticvg system, to 
combine accounting, economic, marketing' and governmental 
criteria. 

In a classic anicle, Alexander (1964) developed a more 
complete system for The Death and Burial of *Siek' Products. 
It> his system* six indicators are used to screen products for 
fLiher analysis: sales strength* price trends, profit trends, 
substitute products, product effectiveness, and executive eflbrt. 
h4ost of the six have analogous factors for monitorir^ educational 
programs. Fallowing this routine product scr&enir^, Alexander's 
second stage consists of a thorough analysis of the selected 
products by staff o^ a comMlee io provide^ adequate decision 
information. Proper attention is given to the same six factors, 
but altemattve opportunities, employ^^ relations, long-run 
benefits for consumers, and phase-out objectives are also con- 
sidep'd Nong with profttability for each unkjuc product situation. 
Infcmi''tMn ftom the analysis is passed on to executives for the 
thiid or decision -making stage of the system. If the decision is 
Jiminf^e, the fourth stage considers {..laac-out problems in 
jctail. Accounting for any holdover demand, timing and the 
diminishing allocation and reallocation of resources provide 
further analogies for educational programs. 

Kotler (1965) provides a developmental system for Phasing 
Out Weak PtD^cts. A corporate team is established to devcl<^ 
criteria forscr^ning. These criteria are translated into a set of 
computerized dc^sion rules to facilitate the screening process. 
A more comprehen^ve set of criteria and appropriate weights 
are then de vcloped and enteredJnto a second computer program 
which provides a standardized retention index. Experience 
with this index permits the location of automatic cut-off points 
for dropping products, for requiring further evaluation, or for 
automatic retention. The latter judgments and possible further 
evaluations are made by a product review committee. In the 
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HnaJ phase-out step, a product ma> be dropped ot phased out 
slowly depending upon situational factors and the timetable 
estabhshed. This system points out the potential for inecha- 
nizingat least die screening processand, with volume, a portion 
of the evaluation process as well . 

Fbr evaluating educational programs^ an amalgam of the 
Alexander ^nd Kotler models wOutd appearto hold promise. It 
IS this amalgam which is developed in the foUowmg sections. 

Procedure for Program Review and Abandonment 

In the sections which follow, a model for the review and 
abandonment of academic programs ts outlined. The model 
consists of four stages and should be applied annually. Its 
objective IS to identify educational pn^grams which are operatii^ 
ineffectively and to phase out those which cannot be rehabili- 
tated. The stages of the process include. (I) initial screening, 
(2) in-depth analysis, (3) institutional-level review and decision 
making and (4) ptogmm abandonment. The flow chart in 
Figure I summanzes the stages of the ptoccdure. The dotted 
line appeani^ between stages one and two indicates that most 
programs do not go beyond the scteening stage and that stages 
two through four are essentially separate from stage one. 

Stage one: Initial screening* This stage is completed by 
a central administrative staff and is designed to pinpoint pro- 
grams which ma> be operating ineffectively and which should 
be considered for possible abandonment. We suggest two 
relatively eas^-to-measuie variables and provide some thoughts 
nncombining these variables intoasingle index to accomplish 
thi:; purpose. 

1. EnroUmem trends^ Program hcadcount enrollments 
for the past ten ^ear& (as available) are analyzed to determine if 
an enrollment decline did occur and, if it did, the speed and 
extent of the decline. We suggest usii^ regression analysis 
(I.e. , the slope of the regression line) to '^etennine speed and 
computing the actual decline in enrollnicnts dunng the penod 
to measure the extent. 

2. tncreasing costs per credit hour. The direct cost per 
credit hcur consumed b> program students for the past ten 
>ears (^s available) is anal> d to ascertair* »Mhcr cost in- 
^reascik occuned ;:nd, if the> did, the rapidit> and extent of the 
increases. We recommend tljiat fonns of analysis similar to 
those sugge^kted for hcaovount enrollments be applied in this 
case. We also suggest that the direct cost per student credit 
hour figure be ccxputed using Onl> the courses taught by the 
department which sponsors the program, 

3* Decision index. Without going into much detail here, 
wc suggest that these vanables be combined into a single index 
todetemune whether ornot a program requires in^lepdi analysis. 
The actual mathematics, variable weighting, and index cutoff 
pomts should be ^t by each institution in accord with its 
experience with the screening procedure and with its own 
special circumstances. The objectives of this index arc, of 
course, to provide a comparable screening measure for all 
academic programs at an institution and to identify a small set 
of ptogianis mqumng fitnher analysis for possible abandonment. 

It should be stressed ^hat, in defining these variables, wc 
have not sought factors which the final decision to abandon 
or rc:tajn a prognun should rest. Instead, wc have defined 
factors which indicate that the program*s continuation should 
be reviewed, with elimination as Cfkc possibility, punhcr analysis 
kould, and many timet; should, leaij to changes in the pr(^^am 
which wtll revitalize it. The infoimation from this stage, for 
ea^h program selected for further review, i^t transmitted on to 
those involved in the next stage 

Stag^ two: fn*depth analysis. Programs identified in the 
initial screening stage are analy2ed In depth in this stage to 
establish why they ore operating ineffectively. The potential 



fo; program rejuvenation is considered along with the costs 
and benefits of possible abandonment. 

The analysis for each program is completed by a faculty 
committee appointed by the dean of the college responsible for 
the program. Based on its analysis, the committee makes a 
recommendation as to whether a program should be abandoned 
or continued. This analysis and review is passed on for use in 
the institutional -lev el review m stage threes Serving ex officio 
on the conmiittee are a member of the faculty/administrative 
committee responsible for the third stage -d a member of the 
central administration staff to guide and assist with daia collection. 

The following sections outline the areas believe should 
be considered in the course of such an analysis. 

1. Enrottments. Whyhaveprc^ramenrollmeiitsUcclined? 
Reasons might include, trouble placing graduates, declining 
student interest m the siuect area, and competing programs 

Gin diese problems be overcome in a cost-effective fasNon? 
Possible solutions center on increasing the program*s appeal, 
that is, developing a new program speciality, using innovative 
instructional technologies, cutting tuition, changing the time 
or location in which a program is offered, improving graduate 
placement, developing cooperative educational opportunities, 
strengthening program faculty, or enriching the program 
curriculum. 

2. Placement of graduates. Has the proportion of pro- 
gram graduates appropriately placed declined? Why? The quali- 
fier» "'appropriately," makes these questions difficuh to answer 
There are two dimensions to appropriate placement, levefand 
substance. Fora graduat^Jto be appropHa^y placed, he or she 
must take a job which is^generally filled by a college graduate 
and the substance of which complements the graduate's major 
field of study. Reasons for a decline in the number of graduates 
placed can include a drop in manpower demand in the occupa- 
tional area for which program graduates are trained, obsolescence 
of the program curriculum, or the entrance of competition from 
other institudons into the program area. 

Can program graduate placement be improved in a cost- 
effective fashion? A number of courses of action could be 
taken to solve this problem. They include updating die program 
curriculum, modifying the curriculum so that program graduates 
can be employed in related occupations, establishing closer 
relationships between program faculty and potential employers, 
and development of cooperative education pr(^rams. 

3. Costs: Ascertaining full program cost is a topic too 
complex to be dealt wtth in this paper; it should be sufficient to 
say that wc do not recommend such costing for this travel of 
analysis. We do not even suggest complete direct costing 
because we believe that the primary costs of a program arc 
centered on the program-essential courses offered t?^ ihe depart- 
ments which sponsor it. Thus, the cost data transmitted from 
the initial screening stage will suffice for this stage as well. 

Why i^ve program costs increased? There are several 
reasons why program cost may have increased, enrollments 
might have declined, lowering the student/faculty ratio, special- 
ized courses which reduce efficiency might have been added, 
the facult> might have been ove/ expanded qualiiativcly or 
quantitatively , or instructional equipment costs might have in 
creased inordinately. 

Are there ways the^e costs could be reduced without 
sacrificing program quality? There are several courses of action 
that might be taken to solve this problem, enrollments might 
be increased, specialized courses which are not essential mig^* 
be eliminated, excess oi overqualificd facutt> might be trans 
ferred, retrained, or^ as a last resort, tenninated; equipment 
costs might be redtu-^d; or cooperative or consoitial arrange- 
ments might be arrangtJ with nearby institutions to share the 
burden of high cost areas of the program. 
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Figure I . Flow chart of program review and abamJonmem procedure. 



4* Program producMty: Is the pTDgram productive from , 
a societal perspective? This is an extremely difficult question 
for the members of a piogram to answer objectively* Most 
faculty believe that their piogiams make important contnbutions 
to society. The fact is that the vast majority of pf0§raTns are 
not essential* But there are at least two cases in which programs 
might be considered ot vital importance: where the program 
trains manpower which \^ essential to the functioning of a 
sector of society, and where the program is essential to the 
overall academic program of the institution. 

if 3 program is determined to be essential, then this 
question should be asked: Is there a better way to deliver the 
program? Solutions discussed in the section on costs might be 
considerc<f in answering this question. 

5. Effects on program faculty mdstc^: What efiect will 
abandonment hava on jm^giam petsonnel? If program personnel 
can be transferred to positions in other programs without 
significant loss of income or status, this is nof likely to be a 



deciding factor in the abandonment decision. However, in 
cases where they must be released ^m the institution's employ, 
serious consid^tion should be given to the e.ffcct the action 
will have on the individuals and on faculty/administration 
relationships. Such concern for the human factor is natural and 
highly appropriate in academia. iust how long an institution 
can continue to operate high cost programs in order to conserve 
specific faculty and staff positions under today's difficult ^ 
financial conditions is a difficult question of balance. 

6. Admlnistrmive burden: Does the program consume a 
disproportional amount of administrative time? Weak programs 
generally require excessive administrative effort to maintain 
enrollments, to operate, and to place graduates. Such elTort is 
generally better expended on more promising programs. 

Stage three: ItistUutionaMevel review and decision 
making. In this st^e, the financial impact of the program's 
abandonment on other institution programs is as^ssed by 
central administration staff, the program-level analysis is 
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examined* 3nd a fmal decision is nnade by an institutions I* level 
committee ^ to whether the program should be abandoned or 
continued* Because this committee is required to make extiemcly 
difficult, subjective judgments about the viability of acadcnntc 
programs* it nnust be staffed by faculty and adnninistrative 
personnel who have records of distinguished acconnplishment 
and are known for tl»eir ability to nnake realistic decisions 
under diffici - x>nditions. Serving cx officio to the committee's 
deliberations on each pwg}r:n should be a senior mennber of 
the program's faeully, 

1* Financial impact of program abandonment on the 
institution: The assessnnent of the innpact of a program deletion 
On the institution's financial stnicture should address two 
questions. First* will program expense be reduced nfiore than 
program income will drop? In considering this question, we 
suggest that only income and expense attributable to the 
program-essential courses offeied by the department or depart* 
ments spotisoritig the program should be considered. Income 
should include tuition* general state appropriations* and grants 
from government agencies and foundations. Expense compu- 
lations should consider teaching and support mqppower* fringe 
ben^ts* wages, departmental allotnfient* and library expense, 
A comparison of the income and expense totals* of course* 
provides a measure of tht^ direct buc^etary gains or losses from 
abandoning :he program. 



Seconds what impact would the abandonment of the pro- 
gram have on related programs? The withdrawl of a program 
frequently has impacts on the departments providing service 
courses and on related programs which make use of common 
courses and facilities. In many cases, the net effect is to 
increase the overhead burden of these courses and facilities, if 
they cannot be reduced in scope, on the oiher programs using 
them. This cost must be considered in addition to the 
income/expense figure just discussed. 

2. Review of program-level aitafysis and decision making: 
When central administration staff completes its wodc, the 
tnstitubottal-level conmiittee reviews the ptogram-level analysis 
and the staffs assessment of the financial impact of the program 
abandonnxnt on other institution programs. On the b^'^is of these 
reviews* it lecomnfiends to the chief academic officer of the 
institution whether the program should be abandoned or con- 
tinued. Table I lists the criteria which the committee might 
consider in making its decision. The table alspjncludes questions 
pertaining to ihe criteria, possible answer categories for each 
question, and illustrative numerical ratings for each categoiy. 

After the program has been evaluated on each criterion, 
the ratings should be combined into an Overall program score. 
We suggesf^computing the score by adding the ratings together. 
Cut-off scores for program abandonment should be set by the 
institution after it gains experience with the procedure. 



Table 1 

Criteria for the Abandonment of Academic Programs 



Criteria Que^ions Answer categories Numerical ratings^ 



Enrollments Can the decline in program enrollments Cannot be overcome, I 

be overcome in a cost-effective fashion? Can be overconte fcrone to three years, J 

Can be cvcrconte ibr three to six years, 5 

Can be oveicome indefinitely, 7 

GraJualc placement Can pio^ram graduate placement be im* Cannot be improved, I 

proved in a cast-cffcctivc fashion? Can be improved, 3 

Costs Can program costs be reduced without Cannot be rcduoed, 1 

sacriftciiig quality? Can be reduced by ten to twenty^five 

ptrcem, 3 

Can t>e reduced by more ihan twenty Ttve^ 

percent, 5 

\ 

Program productivity Is tlic program essential from a societal Program is not essential, i 

perspective? Program is essential. ' ?* 

Effects of abandonment What effect will abandonment of the pro* Program personnel can be placed else* I 

gram have on pfognmi faculty and staff? where in the institution. 

Program personnel cannot be placed cisfc- ^ 
^vhere in the Ensritullon, 

Administrative burden Docs the program consume a dispropor* Consumes ajtfisproportionate share, I 

tionaie amount of administraU vc time? ^ j^qfii^ a disproportionate share, 3 

Financial impact of program Will prograni expense be cut niore than Expense cut more than income. I 

abandonment on other programs prt^ntm income will drop? Income cut more than expense, 3 



f^hcriterionshouMbe weighted by in Instiiuijoit \n accoid with its specfal nctA$. 

bThi$ KOTt shoutd be equat to ttic minimum ov«ratt$cure neceisajy fora program to avoid abandonment. 
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S^zgt four: Program abandonment [n the final stnge 
of the process, phase-out plans for programs to be abandoned 
are made, im piemen ted > and monitorcU by a central aiiminis- 
tration staff These staff members axe providc<I with the pro- 
ceedings from eaeh of ;he earlier stages The smooth ^^xecution 
of this stage, with concern for the human faetor and at a 
mtnnnuni of expense, will play an important role in reducing 
the fears and negative feelings currently attaefied to program 
abandonment. . 

The stages of the phase-out plun and a timetable for its 
implementation should be tailored to the program's special 
eincumstanct^s. Some of die factors which should be considered 
in the plants development follow. 

L How k>ng must the program be operated until the 
students currently enrolled arc ^duated? 

2 How soon can affected faculty and staff be shifted to 
other programs? Will some personnel fe<iuire retraining in 
preparation for these shifts? Can others be retired early? Will 
stilJ others have to be released and* if so» what outside assistance 
and severance pay^ arrangements must be made for them? 

3. Can program facilities and equipoent be ^'eeycled for 
use in existing or new programs;? When can this be accom* 
pitshcd? [f facilities or equipment cannot be recycled, what 
would be the most advantageous way for the institution to 
dispose of them? 

4, Into what existing or iicw programs will the resources 



from the abandoned program be recycled? Can the phase-out 
of the abandoned program of the resource rccyehng be co- 
ordinated so as to minimize the disturbance to those involved 
in the abandoned program and maximize the programming 
opportunities of the progr^km receiving the recycled resources? 

With the answers to these and additional questions, the 
plcn is developed. The extensiveness of the plan should be 
related to the complexity and size of the program. The plan 
should be drawn up in such a way that the abandonment of a 
program eauses the least disturbance to those involved in it and 
to the operations of the instiiution. 

Final Observations 

The procedures we have outlined in this paper develop a 
model for the review and abandonment of academic programs. 
We fully expect that institutions which apply the model will 
adapt it substantially to fit their special circumstances. We 
strongly recommend that they do so. 

We fully recognize that successful implementation of the 
model will require strong backing from top administrative 
officers and adept politieaJ handling on the part of all of those 
involved. We believe that many institutions will need a pro- 
cedure similar to this one because their leaders— the admin* 
istrators and faculty— will see it as. a step they must take to 
insure that their oi^ani^ation is prepared for the uncertain and 
difficult years which lie ahead. 



Footnotes 

■Progi^m js (fcffrtcd an offtcblly Jc&ignalcU mapr whKh kjJs to the aw^Jii^ of a Jcgrcc at any Itvcl. 
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MANAGING IN EQUILIBRIUIVI: THE ROLES OF 
PLANNING AND INSTITUTIONAL RESEARCH 
IN THE STEADY-STATE 



Dunng 1975 and 1976, the University of Aibany was 
forced to reduce its teaching faculty by 33 positions, or ap-' 
proximately four percent. That goal was reached through 
progmmntically sinicturcd retrenchment Chotces were made on 
the basis of results of a campus-wide assessment of academic 
programs, an assessment that used eleven criteria of quality 
and appropriateness The immediate results of this process 
were the elimination of two schools and two departments as 
well as the reduction of programs offeied from 129 to III. In 
comparison with other retrenchments, notably ihat of the City 
University of New York^ our obligation was not remarkable 
in a strict numeric sense. But the cuts were deep enough lo 
persuade us that, in addition to making spceiflc program 
decisions, the entire proces: by which lesources are managed 
should be considcred.^Thust the longer range result was a 
commitment, within die expectation of a continuing equilibrium 
budget, to the planned developtnent and strengthening of the 
'program offerings that remained^ 

Tliat commUment requites more than verbal assurances 
for its itrtpletnentation. For example^ which departments should 
be developed and strengthened? Where do we stand now? 
Have previous resource allocatk)ns niet the desired purpose of 
development? Is there a proper relatbnship developing between 
trends in enrollment, program quality, and resource allocation? 
These questions are inherent in any university tnanagetnent* 
but our experience has shown that in times of growth there isn 
higher level of tolerance associated with both question and 
answer than can e^^ist tn a no-gfowth period. A steadily In- 
creasing faculty carries with it a forgiveness factor: if tKe 
allocation of new positions in one year has not led to a 
qualitative increase in a given department's faculty, there will 
always be another chance to obtain quality with the next year's 
allocation In times of growth there is abo a tendency toward 
less stringent examfnation of qualitative chnnge: if the institu- 
tional research office's efforts are directed toward support of 
budge, growthf it may not (or need not) spend much titne 
assembling data pertaining to the harder questions of accom- 
plishnii.nt And* after a period in which faculty and adminis- 
tration have become accustomed to growth and to an expan- 
sionist view of the future, who wants atighter managerial rein? 

As we bcgnn to think more seriously about planned devel- 
opment, it quickly became apparent that there is an underlying 
theoretical process from planning through budget allocations 
to activity analysis and evak'ation, a reexamination of goals» 
nnd a further look at allocation levels. Since the process should 
be n continuing one that rapidly becomes a feedback loop— as 
the results of one cycle form a foundation nndstarting point for 
the next — the pr(icess seems virtually self-evident. Sound ad- 
ministratlonf with predictably good prospects for program 
development, could thus be instituted rather easily by a more 
conscious amalgamation of the process into a structured and 
coherent mnn^erinl style. 

Few campuses are so self-contained ai!d self-sufflcient 
thnt they can ensure such control of the environment that an 
integrated mnnagement system could automaticnlly succeed. 
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But» even granting a measure of uncertainty and a willingness 
Co tolerate attendant ambiguities, eould not the process be 
impletncnted with a fairly sitrtple set of procedures? 

Not quite, and the purpose of this paper is to describe how 
^e have found this to be the case. Our principal diseovety has 
been that the integrated managerial process is a secondary 
characteristic of administrative activity. More importantly, 
each step in that process ttas a cyclical life of its own that is 
independently, and often.extemally^ govemed. The integrated 
process is still needed- and institutional research bears a heavy 
responsibility for developing and supponing it. If we arc to 
make a success of it, we have to begin with a elear grasp of the 
dynamics by which each of the planning- manng in g- evaluating 
activities is governed. That task has been one of our principal 
objectives this year and now we would like to^describc our 
efforts to comj^letc \u beginning with an overview of the 
separate activities that faced us. 

The AdmEntstrative Mosaic 

There are seven principal netivities on campus that com- 
prise the nucleus of an integrated management process. The 
first and oldest — and the one most circumscribed by policies, 
procedures^ and traditions — is campus budgeting. It is an over- 
lapping, three-year process which* becnuse of the state fiscal 
system and its heavy etnphasis on accountability, has always 
had an extemal focus. The timetable and structure of the 
process* as well as its content* are determined off campus by 
the central staff of the State University and by the New York 
State Division of the Budget. Line item control, expenditure 
ceilings, pre-and postaudit are the more noticeable elements of 
the financial environment which contribute to our limited 
financial flexibility and heavy paiperwork load^ But* from an 
integrated managetnent perspective, the most evident considera- 
tion is its basic timetable. The sute u^H yearsiarts on April K 
and our accounting and budgeting systems conform to that 
even though the acadetnic year runs from September to August. 
This automatically creates timing problems Avhich are evi- 
denced, particularly, in resource allocation, the second of our 
principal activities. 

In our circumstances » resource aiiocathn has less broad 
implications than is usually the case because resources are 
provided to the university by specific categoty (faculty, staff* 
supplies, aT\$l equiptnent) and by purposes for which they can 
be used (instnielion, general administration, matnienanoef and 
operation). This is a significant factor in limiting the flexibility 
of campus management. Because our campus is also govemed 
by a fiscal year that begins April 1 , we have traditionally been 
handicapped by having only minimal lead time for makmg 
nllocatk)n decisions and for the recruitment efforts that follow. 
There is generally less thnn six months advance notice of 
available resources before the start of the academic year in 
September. Consequently^ tentative allocations and rccruitnK*ni 
must begin prior to final budget clcarancct Also, the ycar^by- 
year approach to bud^tjng has meant thnt allocations nre 
gove med by a similar short-range ' lew. 
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Enrollment planning is our third major activity. W is an 
obvious component of a fonnula-based budget system, but in 
that context it has been limited by shoit-iang^ tai]gets and 
campus^wide focus, (Additionally, we were limited in previous 
years b> a SUNY policy that projections* once submitted to the 
legislature^ could not be chang^, even -n the following year 
when additional data» then available as a projection base, did 
not match the previous year's assumptions. The policy guar- 
anteed discontinuity in budget projections). Longef range and 
more detailed projections were a function of capital planning, 
which was historically senii*independent from academic planning' 
The capital plan reflected *exte ma I political expectations of 
growth-— as evidenced by their survival well after the hard 
facts of a declining enrollment pool became known — and 
enrollment projections were calculated to fill buildings, not to 
guide dcpartmen^l development. 

Enrollment forecasts had some bearing on our'fourlh 
activity, master planning, A quadrennial plan is required of 
eveiy public and private institution of higher education in New 
York Slate; for gUNYi a single, comprehensive plan is pre- 
pared. By emphasizing a positive look at the past and an 
optimistic gaze into the future, it is designed primanly to 
educate exiemal readers. Its rhetorical style» the absence of 
campus idenliO^ and participation (after submitting the lequir&d 
pre]] mi naty paperwork), lack of meaningful feedback to campus 
input, and the .lack of realism in discussing enrollment and 
finances has meant that, even though the document may be 
externally persuasive, little campus benefit or purpose is seen 
or deKved from the process. Its extemal focus is not, and 
cannot be, specific or pertinent to campus planning or decision 
making. It is well that it is not^ for each instimtion, like Albany, 
needs to set forth its own master plan andjdcvelop a process of 
implementation. 

Since 1966, in addition to enrollment reporting, the senior 
insdmtions of the State Univcrsi^ have participated in a centrally 
designed workload analysis p,^ject. Called the Course and 
Section Analysis (CASA), it is a line by line description of 
every section taught in the t'all semester. Each section is 
described in terms o* department, HEGIS discipline, instiuction 
type, credit value, scheduled da>/time/room/btiilding, number 
of students by level, instructor and instructor contact hours in 
section per week; The project works by having the campus 
submit raw data to the central staff, which *'owns" the analytic 
programs; ultimately the results are retumed to, us. 

The cumbersomencss of a multicampus system meant 
originally that analytic results were never established before 
the beginning of the next academic year. Campus demands for 
faster service were ultimately heard, however, and Albany 
now receives its own results six months after the semester 
begins. 

The fi'1 SUNY report is not available for several more 
months^ andUwhen it does appear, it suffers from a latk of 
timeliness and from an overwhelming amount of uninterpreted 
and incomparable data. Even improved tum-around time for 
local data is insufficient^ however, as allocation commitments, 
for recruiting purposes, must be made earlier in the academic 
year. In addition, the analytic routine focHses on comparisons 
across depanmcnts rather than development overtime and the 
^ data encourage jostling over increasingly limited resources. 
Most importantly, however, in the absence of established 
program priorities, faculty workload data, as welt as enrollment 
trends and pressures, are not sufficient f'^*- making resource 
allocation decisions, 

Graduate program self-studies and external revie^vs, ihe 
sixth aedvity jn our managerial process, have been a dc^mt- 
nuental effort, intcmally defined and operated^ for the last' ten 
years. Each programf is reviewed on a f>ve*ycar cycle, which 



can t>e altered ^ necessary to accommodate accreditation 
visits. Reviews have focused upon departmental assessment 
and self-improv enfant without significant relationship tocair,;%js 
developnuent. Only with the arrival of steady*state budgei, .g 
has the activity been seen ^ useful to the setting of campus 
priorities and to l^e establishment of allocation levels. As that 
value has emerged, however^ extemal forces have moved to 
coopt the process. For example, the State Educadon Depart- 
ment has used its authority for approval an4 registration of 
academic programs as a justification also to reassess and to 
exercise a pcrogative to close a program it doesn't like. The 
result has been a statewide, public and private, review of 
doctoral programs. The review has been ^ attempt to assess 
all programs in a given discipline b> statewide comparisons; 
programs are then labelled e^er as satisfactory^ not satisfactory, 
or recommended for termination. As a result^ the review has 
become a weapon of Ihe unsympathetic outsider who» by 
altering the purpose of the review, threatens the university's 
ability to set and follow its own priorities. 

It is appropriate that Inpmatlm systems development is 
last in our list of activities needing to be drawn into a campus* 
d^ned managerial process,. It is an activity that has been 
greatly influenced by die other six. The combination of extemal 
requirements and individually perceived iniemal needs has 
resulted in system development elforts that focus on the trans- 
actional activities of each administrative office- rather than 
upon campus*wide man^ement uses of data, IndividJal oflfice 
needs have predominated^ often heavily influenced by external 
requiiuments. In at least one case^ an information system 
began as a result of our initiative hut was rapidly reoriented to 
satisfy external needs. The system is in place* but it has not 
been meaningfUII> integrated into campus operations, and the 
campu^j has not been <ihle to realize its managcinent and 
planning potential. 

In summary, we had accumulated seven administrative 
activities which had been designed to follow the beat of an 
extemal dnimmer. How, then, could we meet our recognized 
responsibility to account fbr the use of state funds — and also 
meet our responsibility to plan and manage the institution? 
This was the challenge facing us as we began to think seriously 
about an integrated man^ement process. 

Developing an Integrated Ptwress 

It is not difficult to see how these seven ongoing campus 
activities ought to fit together to form an integrated manage- 
ment process. Operationally, however^ thcie are considerable 
barriers to its implementation. The easy and log!' ,! conceptual 
flow from one activity into the next stands in sharp contrast to 
the Uncoordinated and independently directed reality wc have 
just described. The conflict can be appreciated simply by 
comparing the schematic outlines of theory and reality in 
fiSores I and 2,,^^ 

Our desire to impose logic and integration on these activi* 
ties has remained finn despite the conflict, and 3 solution is 
gradually cmergin|g. It has four components, three of which 
have been necessary operational steps and one a conceptual 
reorientation in our approach to data. 

The first step was an administrative reorganmtlonf through 
which a new ofYicc of information and planning was created 
within the OfHcc of the President, Its two components, now 
brought together for d3c first time, aredscOfnceorinstimtioral 
Research and the Computing Center, which includes a staff for 
administradvc systems development. These units provide critical 
suppo'rt for an integrated management process; but, previously, 
they^ had functioned with more independence than the process 
merits. Institutional research had been heavily influenced in 
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the past by external reponing requirements. The administrative 
systems staff had been eoncemed primanly with transdetional 
activities' of the fcgistfar> buisar, and other administrative 
officcrs^ Staff attention can now be focused^ through leadership 
of the president's office* on support for campus planning, 
institutional management, and program evaluation. 

A commitment to the planned development and support 
ofacademic programs requires more than staff inicgiation. The 
second operational step was to develop a clear statement of 
insthutlomi goats and objectives (o guide the long-range 
management of the university. A campus mission statement 
has t^n the principal vehicle for doing this. It is a broad 
framework, intended to enjoy a degree of permanence Within 
which individual units, academic and administrative* can iden- 
tify their panicular long-tcmi goals and development strategies. 
The mission statement was developed in 1976; upon its com- 
pletion, thicc-year'ijevclopmcm plans were prepared by cadi 
depanmeni and office on campus. They arc now being reviewed 
by the president, in conjunction with appropriate vice presidents 
and dcanst and with the advice of the Council on Educational 
Policy of Ujc University Senate. <It should be noted that the 
council also played a key role in development of the mission 



statement itself.) Taken together, the mission statement and 
development plans provide ihc starting point for a process that 
will link ongoing campus activities with a strong and stable 
future- 

The third operational step in the development of an in- 
tegrated management process has focused more directly on our 
approach to information systems. Our current systems are a 
conglomeration 6f computer-based routines, each of which 
was designed to meet the particular needs of specific offices. 
Wc have broken from that tradition and am well into a new 
approach that has its focal point in campus-yvide sytems 
development. We are now con(^ntrattng on two primary devel- 
opment efforts* one dealing with student information and the 
other with financial information. Bach has its own steering 
committee of representatives from each office tfiat needs access 
to student or financial information. The steering committees 
overlap; the bursar, for example, is involved with both groups. 
The camptrs-wide approach represents a commitment to systems 
that will support' transactional, analytic; and^anntng needs 
for information. 

The final component iniour ag^roach to an inicgraied 
management concept has beenVi^cfinition of the conte^ 
within which management information is used. We call it the 
informed environment. The informed environment is one that 
supports the formulation, implementation, and evaluation of 
institutional policies and procedures. It supports this process 
not through a one-to*one correspondence between selected 
pieces of inform^ion and specific decisions but rather through 
the existence of a longer term understanding by decision makers 
^ of institutional development and die information used to describe 
that process. The information obtained from current operations 
supports the process primanly by contributing to a long-term 
body of knowledge, ft is upon.thts body of knowledge that the 
institution relies for support of specific decisions and, in so 
doing, is freed from the constraints of the current timetable of 
data collection, editing, analysts, and presentation. 

The informed environment concept provides a new per- 
^ spcctive for viewing die administrative activities of the campus, 
one that opens up alternative solutions to the problems of dis- 
jointed timing and external control. We have learned, for 
example, that not all externally determined timetables need 
hinder campus activity. Insteadrwe can develop an institutk>na^ 
memory that informsusof thelikely^ignificanceofprclimtnafy' 
or fragmcntaty data about current events and enables us to 
make current decisions or future commitments. We still must 
conform to the state's fiscal year for budgeting and subsequent 
allocations. But, by assembling appropriate trend data on 
enrollments and faculty, and by placing them within a campus- 
wide framework of development goals and priorities, we can 
bring greater wisdom to those times when recruitment commit-' 
ments need to be made. In addition, the continuing presence of 
that institutional memory becomes the framework for keeping 
track of those commitments. Our present sense of position can 
also be enhanced by a continuing appreciation of pastwodcload 
charactenstics that enable us to identify continuing trends or 
possible anomalitics through preliminary signals of current 
data. How, for example, h^ve spring enrollments differed 
from fall enrollments? 

The consequence of the informed environment is a con- 
tinuing body of knowledge, not simply new reports. This 
objective has a profound ttitluence on the institutional research 
fiinction and upon information systems development. Our 
responsibilities stretch beyond short-mnge data targets and the 
manipulation of current data for current needs. As a result, we 
arc better prepared to support both pining and evaluation 
and, by supporting them, to Improve the information dimple 
within which institutional management occurs. 
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Figure 2, The administrative mosaic of the University at Albany. 
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Evaluation anil University Public Service 

While it is generally accepted that teaching, research, and 
service are the three primaiy functions of a university, the 
service function ofthe university's mission has usually received 
less attention than the other two In part, of course, this lack of 
attention is due to the fact that only Jif^servicc has been given to 
the service function by many institutions and noi much real 
efTort or support has gpne to service programs. In other cases, 
notably the land grant colleges and universities where service 
has been ^ major eoneeri] of the institutk>n» the continued 
support and encouragement 0^1 ^*era|^nd state governments 
through funding and program development has placed the 
service activities in an almost independent status, beyond the 
normal review of the academician- 
While the service activities of colleges and universities 
have typically gone tinchallcngcd, it is tme that those responsible 
for service activities have been concerned about the effective- 
ness of their progi^ms and have conducted evaluations to. 
determine the success of their efforts- It is equally (me that 
funding sources and other interested parties have also been 
asking for indicators of the success of the^ etideavors now that 
a variety of university needs are competing for scarce dollar 
resources. University public service must show accountability 
to legislators, governors, taxpayers, boards of regents, and 
institutional administrators as well as federal funding agencies. 
The public service function of the university is now clearly 
subject to the same pressures for evaluation and accountability 
that the teaching and research functions have previously 
encountered* 

In spite of the intense interest of edueatoi^ In evaluation, as 
witnessed by the recent attempts to apply the teclini()ues of 
management by objectives (MBO)» planning-programming' 
budgeting-systems (PPBS), cQSt/bcncfit analysis, zero-based 
budgeting, and social tndieato? analysis to the educational 
setting, a review of the literature and research reveals that 
formal techniques and methodologies for the evaluation of 
service activities and programs, which account fully for the 
Unique aspects of the service mission, have not been adequately 
formulated Or developed- 

The only real measures of accountability of University 

Sublie services, to date, have been tied to perfonnance. Man 
ours of cffoH, numbers of people attending training sessioni, 
numbers ,ind types of local governments being assisted, and 
dollar costs for programs and services are typical of the measures 
used 10 indicate achievemdfht. In the past» such measures were 
adequate to insure the continued flow of support formaintainii^g 
and expanding the public j;ervicc role of universities Inflationajy 
costs, however, have considerably reduced the flow of resource 
money (in terms of real spending power) and with these rising 
costs has come a demand for more meaningful measures for 
evaluating the worth or value of the public service endeavors. 

Ctcflnltlon of Evaluation 

Evaluation means different things to different people an^ 
may even take on diftcrcnt dirncnsions in different settings 



depending on the situation and what is being evaluated. These 
valiant veiws form a continuum- Atone extreme on the evalua* 
tion eoi^tinuum is the entirely subjective "gut** feeling that a 
good job is or is not being done» while at the other extreme is the 
completely objective position that evaluation must meet the test 
of scientifically controlled experimental research. Between the 
two extremes arc combinations of the subjective and objective 
where evaluation may be equated with the simple monitonng of 
projects and Activities or where an even more formalized 
statement of objectives may be coupled with criteria for mea- 
,'Suring performance and/or impact. 

Basically, evaluation involves ma)cing decisions as to the 
worth or value.of somethings and most definitions pf evaluation 
explicitly or implicitly contain the concept of value or worth, 
6ut evaluation is also viewed as a process to aid decision 
ma)cers in making intellijgent decisions. Both of these concepiK 
are embodied in the evaluation methodology being proposed 
here. 

Purpose of Evaluation 

The basic purpose of evaluation is to provide meaningful 
information to decision makers. In the context of university 
public service, evaluation can serve to aid both iniemal and 
external decision ma)cers. Internally, the evaluation could be 
used for self*improvemcnt or to determine priorities for alloca* 
tion of resources. Externally, evaluation could serve toex^mine 
certain dimensions or characteristics of an insntution*s public 
service efforts, Theresults, based either on individual dimensions 
or in some weighted combination^ could then be compared to 
corresponding results from other similar institutions or to some 
standards or expectations. 

Thcspccifjcpurposefortheevaluation will depcndon who 
wants and uses it. Ideally* the evaluation effort should teflect 
the intent of the decision malcer who is looking to an evaluation 
for objective aid. For example* a fUnding agency may want ' 
evaluation whichean be used as ab^sjbr comparing thepublie 
service achievements of one university with those of another. 
Again, a university vice president for services may want the 
evaluation ofhis university public service component in order 
to determine whether and where improvements can be made. 
Clearly » the evaluation emphasis ^vouJd be somewhat difteient . 
in the two instances. 

An Evaluation Methodology 

The proposed evaluation methodology has three basic 
components as shown in Figure I, a program component, an 
institutional capability andcommitmcntcomponent^andauser 
component. 

Although each of the three components can be administered 
as an independent element, the usefulness of the evaluation 
process is enhanced by combining data from the three com* 
ponents t^ develop a pyramid of evidence to aid the dcci^^ion 
maker. For example, suppose that a funding agency is cOn* 
^sidcring whether or not to support the development .of a special* 
ized training package at a given university. Based on the 
capability and commitment component, evidence ma> suggest 
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Figure L Overview of evaluation process. 

■* 

that the university has adequate facijilicst staffs and commit- 
ment* The program component may yield further supportive 
evidence by showing that the training unit has been highly 
successful in reaching target ^lidicnccs during the past year. 
The user component may alsoprovidc positive input when users 
testify to the benefits dcnved from their previous training 
expcncnees with the university. 

llic program component attempts toestablish uscrrclated. - 
objectives and criteria ag,^lnst which to measure the impact of 
university public service efforts. Inpufobtaincd fr^m the user 
component will enable university public service staff to know 
whether these user>rclatc<I objectives arc consistent with the 
users* needs and problems. At the 5Amc timc» the commitment 
and capability component can provide infom^ation about the 



university's mission^ organization^ funding, ete.r which also 
serves to guide professional staffin their program development. 

The Program Component 

The program component is intended as a sdf-evaluation 
designed to be used internally by an institution. It is aimed ^t 
assisting institutional decision makers to logically and system- 
atically assess the value or worth of their public service en- 
deavors. Through a continued application of this mechanism to 
cntically review and analyze its service program* the institution 
should be able to improve its overall performance and effective- 
ness. This process will also enable the institution to better 
Understand and communicate the foltowlng: 
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Figure 2« Program c valuation ^ framework. 



). What the institution is doing with respect to public 
scrviec 

2p Why the Institution docs what it does 

3. Kow the institution goes about its public scrvte.: vvork 

4. What degree of suecess it is having in meeting needs 
and refiolving problems in each of its public service prograin 
areas. 



The conceptual framework for this component is shown in 
Figure 2. The process incorporated in this framework consists 
of the followijig steps: i 

1. Identay overall institutional goals for public service 

2. Identify public service Z^^^ of various units involved 
with public service (centers* in^titutcs^ departments^ ete.) 

3. Identify program areas within respective units 



lis 



Evaluating public service activities 



4* Eslablisli objectives for each prpgram area 

5. Indicate projects and activities undertaken to satisfy or 
achieve objectives 

6. Determine evaluation criteria which will measure 
achievement ofobjectives. 

Articulating institutional and unit g^ls is important not 
onl> to the program component but to the other bmo components 
as wclL These goals identify why public service exists at the 
institution and indicate what each unit is attempting to ac- 
complish. Although these overall goals need not be state<i m 
specific, measurable terms, they should be stated in such a wa> 
that One can determine whether progress toward these goals is 
or IS not being made. 

Hie process assumes that each unit involved in public 
service performs its work activities within a framework of 
program areas or, at least, that its work activities can be 
classified insomc way, Criminaljustice, governmental finance, 
management training, and engineering might be some examples. 
It would be expected that a given institution would have a 
unique set of program areas. The differences between institu 
tions are the result of acombination of factors such as institutional 
goals, staff, and available resources. 

An the evaluation process, objectives arc defined as an 
end product or end condition desired some future time« 
Objectives must be understandable, achievable, and measurable, 
Rgurc^ 2 shows three levels of objectives for each program 
area: ultimate, immediate, and intermediate. 

The first, or highest level of objectives is called the 
ultimate or long-range level. These objectives go beyond what 
the institution or university itself can do directly in ]ts service 
role. For example, the university isnotagoveming body, yet it 
may have as a legitimate, ultimate ob^tivc to inciease the 
efficiency and effectiveness of local govemment,The university 
cannot directly effect this condition. Ultimate otgectives are 
basically user^ (or client-) related objectives, 

A second purpose for this level is that it will enable the 
university to see, over a period of time, wf^ther, and to what 
degree, desirable goals are being achieved, the university wtU, 
thui, have the means for evaluating itselfonalongitudinaj time 
basis in terms of its impact cm long-Jerm problems and needs. 

In addition, given well-expressed ultimate objectives, the 
institution (or public service unit) should be able to distinguish 
between effective and ineffective programs— again in terms of 
long-jangc desired impact. Information will thereby be available 
for decision makers to make timely planning dccisk>ns regarding 
continuation or proliferation of prpgrajns within its sphere of 
influence* 

It is recognized that the programs and projects of the 
institution are not the only contributors t^^ these long range. 
chcnt-cCfitercdobiectives, Programs of other agencies, together 
with a number of uncontrolled factors, have impacts On these 
same objectives, Conscqticntly. precise judgments as to cause 
and effect relationships between the institution's programs and 
the^ observed changes cannot generally be made usii^ this 
evaluation component* Howeveri the process does piovidc 
decision mal;ers with the knowledge that their objectives and 
program intents arc, or are not, consistent with the observed 
changes that are taking place in the real world. 

In contrast with ultimate, user centcted objectives aie the 
immediate objectives where the institution affects or influences 
in a direct way. These are, In fact, university or program 
objectives, Infunediatc objectives need to bcstated in measurable 
terms and should include a specific time frame for completion. 
They should relate directly to projects and activities undertaken 
by the institution or public service unit. They give direction to 
planned activity in all of the institutk>n's functional work 
areas — applied research, technical assistance, and training. 



These objectives should also define results* or end products 
tobcachievediand notactivitiestobe performed. Pinali>.the> 
ought to bear a logical and consistent relationship to the 
ultimate objectives. This may require some assumptions or a 
''logical leap" between the two, 

Intermediate objectives bridge the gap between that which 
the institution can influence directly —the infunediate objectives 
—and that which it can only affect indirectly— the uhimate 
objectives. In many cases, this intennediate level is uratecessary, 
but in other instances it is a useful level to reduce a complex 
ultimate objective into meaningful substantive components. 

After dcfinii^ objectives, the next step ts to ideiHtfy 
projects and activities required to carry out the immediate 
objectives. These projects and activities, in turn, become the 
basis for enumerating pefformance measures which, in the 
self-evaluation model, are measures of work output, Perfor 
mance is simply a measure of the extent of effort or the number 
of activities completed. They are *'means" oriented. Examples 
of perfotmance measures might be the number of training sessions 
he Id. ^publications prepared, nufnber of technical assistance 
visits madCi or number of man months of effort. It should be 
noted that both dielists of projects/activities and the performance 
measures relate directly to the immediate objectives in the 
hierarchy of objectives. 

The final step in the self-evaluation model is to establish 
impact measures. Such measures should be designed to give an 
idea of what effect the work is having on the direction of the 
stated intermediate and ultimate objectives. Impact measures are 
"'end'" oriented. Some examples of impact measures might be 
the number of cities adop qnd implementing standardized 
budgeting procedures or the tviative dollar savings experienced 
by those communities implementing cenain productivity 
programs. 

The development of the evaluation criteria follows from 
the establishment of objectives and planned actionrAs noted 
earlier, objectives should be cither directly measurable or 
should be structured in such a way that one can implicitly 
develop criteria which indicates achievement or prqgress toward 
achievement. For some objectives, notably the immediate ob- 
jectives, it may be that only performance measures can be 
obtained. In other cases, say at the ultimate level of objectives, 
only impact measures jcnaty be appropriate. 

In developing cva]uatk>n criteria, one must give careful 
attention tothe data requirements associated with the individual 
measures. If data used in conjunction with performance or 
impact measures are not obtainable (or are too difficult or too 
expensive to get) such criteria can be of no practical use, 

A criterion forjudging the achievement of some desired 
objective is oOen dependent on having baseline data indicating 
a condition at some previous point in time. If these data are 
unavailable, the criterion is of questionable value. For example, 
a measure of the impact of a technical assistance project on 
energy conservation may be the reductk>n in the energy con- 
sumption of the communities involved in the project. Ff one has 
no estimate of the energy consumed for a comparable period 
before the project begins, then one has notfiing to compare with 
at the end of the projects. 

It is also important to emphasize that the development of 
good evaluation criteria is highly dependent upon the ingenuity 
and innovation of the staff persons working in the institution's 
public service programs. Developing useful and practical criteria, 
like writing meaningful objectives, will not just happen. 

The Institutional OipflA)llfty and Commitment Component 
This evaluation component ts concerned with assessing the 
institution's capability and commitment with reference to public 
service. The procedure associated with this component in- 
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ventorics and examines in an objective fashion eight chaiactcr- 
istics of an institution's public service function. 

Jfthepurpose of the evaluation is toeomparetwooTmon! 
universities in tenns of their public service capabilities* these 
data could provide an objeettve basis for the eomparison. 
Relative or arbitrary standards could also be used as nonns fora 
particular eharaeteristie against which an individual institution 
or public service unit could be measured. lAn example of a 
relative standard might be the inerease in funding support for 
publie service over a period of time. A thirty percent increase in 
fundijigforpublicservfccovera two-year sban of lime might be 
considered a significant positive indicator ofuniversity support 
for public service. Or, an arbitntiy standard might be set for a 
given characteristic F^r example, it mighc^be established that, 
unless a public service unit had ^t least two fuJ|^tirnc piofessionals 
working in public service, the unit would Teceive a below- 
standard fating for that characteristic. ^^ 

The eight characteristics covered by the institutional cap- 
ability and commitment component are as follow^. 

1. Organization 

2. Administrative influence 

3. Funding support 

4. Staffing^pattem 

5. Facilities ^ 

6. Status and reward stnictupe 

7. Mission 

8. Program of work. 

These are not listed in order of priority fi'nce the priorities would 
have to be detennincd by the user of the evaluation process. 
Data should be readilyobtainabte fora given institution for each 
of these characteristics. Each of these eight factors is an 
indicator of the eapabiltty and commitment a given university 
has with regard to public service. Used conectlvcly in the 
evaluation process* they should provide decision makers with a 
{lound basts of facts on which to judge the institution's value or 
worth in tenns of public service. 

A set of questionnaitts and interview instnihnentSi along 
with the methodology for implement at ion » have been developed 
for obtaining the requisite data for this component. 

The User Component 

The user component seeks to obtain feedback from the 
recipients of university public service. Fonn the perspective of 
either an internal self-analysts or an external evaKiatioui it \% 
Important that the views and perceptions of the intended bene- 
ficiaries be included as part of the evaluation process. Data 
obtained from eonsumers of university public service can 
indicate not only whether the goals and objectives of the > 
institution are in keeping with the needs and problems of the 
public they serve but also whetherthey arc realty being achieved. 
User responses arc also usefUl in pointing out strengths and 
weaknesses of the various programs or projects of thei^niversity 



and ean indicate substantive areas of service that need to be 
startedi stopped^ or modified. 

Because the evaluation process places considerable em- 
phasis on detennlning the impaet of public service efforts, the 
user component takes on added significance. Input from this 
eomponent can provide a better understanding of both the real 
and perceived needs and problems of elientsof university public 
service units. In addltton> client objectives and client expecta- 
tions ofuniversitiesean be ascer^ined. In tum, this information 
can, hopefully^ be translated into more appropriate and ad^uate 
public service programs to be initiated by universities. 

For several reasons> it is expected that the results of the 
user survey will be somewhat biased in favor of the university. 
There is a natural tendeney on the P^ of most users to reflect 
favorably on university-provided services since these services 
are usually obtained ^ little or no cost and since therc generally 
exists a/cordial relatidnship between universities and state and 
local govemments.y A^so. since university professional staff 
will tx/involved in identifying and,contacting specific users for 
the interviews, tf^c^v^vill likely select users with whom they 
hav^ had successful prpgnrm. This suggests that considerable 
care should be exercised in selecting and interviewing user 
contacts and in interpreting the results obtained. 

^ questionnaip has also been developed for this evaluation 
component. It is^nlended to be administered during an inter- 
view Wllh the user although, if necessary> it could be used as a 
mail-OLi^. Jhc interview procedure 1s preferred because im- 
portant issues could be explored and implications could be 
probed. 

Concluding Remarks 

As indicated t>y the titles this paper describes a conceptual 
model for an evaluation process. The three components com- 
prising the modeli although developed> have not been imple- 
mented in a thoroi^h fashion. The pcognm component <for 
self- analysis) is currently being implemented on a limited basis 
in a service unit at the University of Georgia. The other two 
components will be pilot tested at the University of Tennessee 
in May 1977. As a result of these test efforts^ the evaluation 
process will be further refined and improved. 

Many educators and administrators feel that university 
public service progiamming will assume an even larger role in 
the university community due to declining enrollment' and 
public demands for relevance. As publie service assumes an 
expanded role, it will be important to develop mechanisms for 
evaluating efTorts in this area. The concepts enunciated m this 
paper are intended to provide a basis for meeting tliis need. 

Themodeldbscfibed in this paper is designed for evaluating 
universi^ outrcach efforts to the piiblic sector (i.e. state agencies 
and local governments). However^ the concepts are elearly 
generalizable to a broader speetnim of university outreach 
programs including continuing education and extension pro- 
grams in general. 
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Mounting expenditures for postsecondary education com- dif^^ni policy aliematives. Similarly, water and air quality 

bined with increased demands on state govcnunenis for new indices provide clues about the changing conditions in the 

and expanded social services have intensified pressures for environment, and summary data about mOftality^ moiitidity^ 

postsccondary education accountability. Various agencies of inCajit moitaJilyr and life expectancies make it possible to 

state govcxTunent collect a wide variety of data from pest- monitor the natu>n's health. Postsecondaiy education, ho'ivev^* 

secondary education. At the national level, agencies of the does not have a set of commonly accepted indicators^ and 

federal government likewise collect general statistical infonna- policy deliberations are correspondingly limited. As GooJer 

tion about postsecondaiy education, in addition to the myriad ( 1975) has poinidd out: 

of data required in order to administer specific programs. )Vhatiseducation?Considerthemyrfadofwaysin which 

Ptofosstonal associations, researchers, and others contribute education is described: the numberofpersons graduating 

further to thQ prolifisration of data collection eff^. from high school; senior citizens eng^ed in learning 

Yet, despite the increased hrtfoimation flow and account- activities; . . .inequalities in school finance; Ph.D's driving 

ability demandSf there remains dissatisfaction with the data cabs; American Nobel Prize winners., Bits and pieces of 

used in the decision^making process in postsecondary educa- ^ the stoiy of educa^on abound. How can we make sense of 

tion, and there is little evidence that the consequences of ' this incredible array of information? How can we know 

policy altematives are more clearly understood. $tmilai;ly, as where we are in education and ftom where we've come? 
more data becoines avaitable* the propenshy of government 

officials to focus on. institutional op^.^ations increases in a Postsecondary Educational Indfcators 

manner that can further erode effective jnstitutiruial man^e- While the need fbr development of indicators is not unique 

ment. ThuSf at the same tinie that ever increasing quantities of to postsecondaiy education^ the need for postsecondaiy educa- 

data are being collected/piocessed, ?nd stored, those persons ttonal indicators is substantial. There has always been a 

who make decisions at state and national levels cominuously general interest in knowing where we are and where we've 

deciy a lack of relevant information on which to base their ^ been, in response to an expressed need to understand changes 

decisions about postsecondaiy education and with ^vhich to that are occurring in our society and in postsecondaiy education 

evaluate the relative effectiveness of the support that i;; provided and the impacts of those changes on people^s livcs^ the idea of 

to postsecondaiy ed'ication. - ' indica^rs has emerged. While the concept of indicators is Qot 

This paradox of deprivation amidst abundance is explan- new, the notion tiiat indicators can be used to describe and 

able in many ways. In some cases* the problem is availability monitor noneconomic or social phenomena, and diat they can 

of the necessary data — those data most needed for certain be applied to the public sector in geneml, is relatively new. 

decisions may not be among 'hose that are collected* or* if Social indicators* according to Bauer (1966) are "statistics* 

collected, may be so out of date or so^ inaccessible as to be statistical series* and all other foimsof evidence that enable us 

useless. In other cases* the problem may be one of data to assess where we stand and are going with rf'^spect to our 

accuracy — while available, the data may be. of such question- values and our goals, and to evaluate specific programs and 

able accuracy that the decision makers refrain from using determine their impact'* (p. J). The role of social indicators* 

them* Perhaps the major problem, however* is one of sheer he claims further "[is] not only to repon where we ap& and 

volume, insufficient^ffort has been directed towards selecting where we have been* but to provide a basis for anticipation of 

and summarizing d^t& about postsecondaiy education into a future states for a continuing reassessment of the relative 

form that is useful;' to individuals other than researchers or probability of the various conditions that have been taken into 

other experts tn the 5eld of postsecondaiy educatioh. Fiequentty* account in planning*' (p. 19). From this defmition* several 

the available data aie not grasped and understood by tt^ users desiral>Ie characteristics of indicators can be identified: 

and, as a conseqi^nce* discreet and dTsafegregaie data are as I . Indicators should fbcus on major aspects of the sub- 

likely to divert attention from broad policy issuesasthey are to jects that are important to policymakers, 

enhance the level of di^ssion and debate over policy altema- 2. Indicator^ have to be sufficiently adaptable to accom- 

tjves, modate various underlying dimensions that are considered in 

The problem is not insurmountable, however. *Ways have policy development. V/hile at one time it was suflftcient to 

been finind to describe complex phenomena and organizations laiow the |Hoportion of the labor fi)icc out of work, more 

in term s^ of constructs that have nieaning to state and national recently affirmative action concerns and programs designed to 

tegisJaidvs and other decision makers. Through the develop- address specific se^nents of the population that are more 

ment of indicatOTS of major oomponents of the econon^* for seriously affected have necessitated the development of more 

examplCf it is possible to assess and describe the nation's disaggregate indicators. 

economic situation. Thus, the gross national product, the 3. Indicators frequently take the form of a simple nnmber 

unemployment rate, price indices* the manufacturing inde/, tliat is arrived at through the use of (sometimes elaborate) 

?nd a variety of othct economic hidtcators enable decision procedures that have been applied to large quantities of basic 

makers to umlerstand the economy and to evaluate, through data. Indicators attempt to simplify and improve the communt- 
thcse indicators, the possible consequences on the economy of . cation of information about important concepts. 
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4. Objectives or goals can fpequenUy be stated in teims 
of quantitative dimensions of the indieatois, thereby enhaneing 
their poliey relevance and utility in poliey deliberations. Thus, 
for example, econOmIe poliey is designed to reduce unemploy- 
ment to five percent while limiting irifbtion to three percent 
per year. 

5 Aixeptanec and use of iujiearois in relation to broad 
social goals is ano:her imponant eharaeteristie of indieators. 
As indieatcd in pfievious paragraphs^ major proposals for eco- 
nomie poliey in the eountiy are frequently presented and 
evaluated in terms of their reported effeet on key indi^cators, 

6 Indieators tendtotaJceon LmportarKC and utility through 
continued use that allows for observations of trends. The ability 
to monitor ehar^e and to lecognize the difference and magni- 
tude of ehange over time beeomes an imponant and necessary 
component of effective indteators. 

What Has Been Done 

Considerable attention h^s been paid to the concept of 
'social indieators during the past two c^eades. Wileox, Brooks, 
Beal & KJonglan (1972), for example, have compiled a bibli* 
ography in excess of one thousand entries related to social 
indieators and soc'etal monitoring. In this bibliography, in- 
dicators are analyzed and described across the entire spectrum 
of hnman sociai experience, heahh, transportation, crime, 
welfare^ religion, education, and others. 

In revi ir^ the literature with particular focus on post- 
secondary eoucation, one is stnick by the considerable anKHint 
of data currently beir^ collected about postsecondary education. 
To be sure, the current data collection efforts do not addressall 
aspects of education; there are major gaps in the kinds of data 
being collected. Most si iking, however, is the f^t that most 
of the education data <ufrently being collected cannot in its 
present fonn be linked to decisions. It is this inability to relate 
edncational data to decisions that is not only ^hc most critical 
shortcoming but also the one which is receiving the least 
attention. 

While the development of indicators about education has 
not received the attention it deserves, work in this area is not 
totally lacking. At the national level, the U.S. Bureau of th^ 
Census collects data that can be Uicd to provide macro-indicators 
about post^ondaiy^ucation. These data, for example, yield 
indicators of oveniil tevel of educational attainment of the 
population, the rates of participation in certain educational 
activities, and participation by sex and racial categories. It is 
significant, however, that census data are not compatible with 
the Office for Civil Rights (OCR) categories required fbr use by 
institutions to establish tar^gets in their affinnative action pro- 
grams, even though census data is referred to by OCR as the 
logical source for obtaining data to establish affinnative action 
targets. 

Another important activity ilow underway is the annual 
report published by the National Center fbr Educational Sta- 
tistics (NCES) (Sec the Condition of Education, 197^^, 1976). 
In these reports, NCES attempts to describe the status of 
education along ^ch dimensions as participation, outcomes of 
schooling, relationships between educa,iOn and ivork, and the 
chax^ict^risties of educational personnel, Similady, the attempts 
by Luptoni ,Augenbiick, and Heyison (1976) in Chanse to 
report on the financial status of higher education represent yet 
anoth^* major national effort to develop postsecondary educa* 
tion indicators. Other efforts include those of Halstcad (1974) 
and Wynn (1974, 1975) to develop indieators of the prices of 
goods nnd services used by institutions of higher education. 

The wode associated with the development and conduct of 
the National Assessment of EducatioiialJProgress (NAEP) also 



represents a fonn of educational indicator. In the I960*s, 
NAEP was created to gadier information about educational 
xhievement for national policymaking. Test results aie analyzed 
accordir^ to respondent's age group> region of the countryi 
sex, race, paient'a education, and the size and type of com- 
munity. Through a contiriuit^ cycle of tests and reported 
results, the NAEP was desigtied to provide a public record of 
the nation's educational status. 

The work of Astin also provides a tongitudhial set of 
indicator data about the kinds of students enrolling in institu- 
tions of higher education. In this Ongping study» data have 
been collected about entering freshmen in approximately 300 
institutions throughout the country. This survey contains a 
variety of demographic items as well as items regarding educa- 
tional and vocational plans, health ratings^ achievements, skills^ 
values, interests^ and other descriptors of students and their 
plans. Through this effort, it has become Increasmgly possible 
to monitor suidcnts enrolling in postsecondary education and 
to observe changes in dieir expectations and aspirations relative 
to postsecondary education. 

At the state level, the National Education Association 
(MEA) annually pMhhes Ranking qf the Stares* which examines 
the states in terms of popnintion and enrollment, attainments 
exp<?nditures, and other characteristics of elementary and 
secondary education, (See NEA, 1973,) At the NationaljOcnter 
for Hi^r Education Management Systems (NCHEMij), McCoy 
( 1 976a, 1 976b) and Weldon { 1 976a, 1 976b) have explored the 
potential uses of existing data (i,^ data that has already been 
collected by some national agency) to describe the sources of 
financial suppon to postsecondary education. These reports 
have been done nsing 1972-73 a..d 1973-^74 data, and they 
examine the measures that can be used with existing data to 
assess various aspects of postsecondary education fromastale- 
level pe^pective. 

Other state^level work includes the annual ranking of the 
states that is published in the Chronkte of Higher Education 
and focuses on the rankings of the states on selected aspect^' of 
postsecondary education and, in Glenny nnd Kidder (1974) 
and Glenny and Ruyle (1973), the examination of state tax 
support of higVier education from 1963-1973, Halstead <I974}, 
as well, devotes a chapter of his book to the development of 
indices and con^parisoDs among the states. 

Work on more miero fonhs of indicators^hose. that 
examine aspectij of an individual institution— are al^ under- 
way,^ Aspects of the Special Report by Change (Lupton, 
Augenbliek, & Heyison, 1976) aredirected to this end. And, in 
the context of a separate project at NCHEMS in 1973, Canoll 
and Collier explored w^ys in which indicators could be devel- 
oped to assess the financial conditions of postsecondary educa- 
tion institutions. These papers were subsequently reviewed by 
a nationni task force in Septeniber of 1973 and several directions 
and suggestions were niade regarJmg funue efforts that NCHHMS 
might constructively pursue. Van Alstync and Cbldien (1976) 
report on efforts in an ACE project to develop measures of 
the ftnancial conditions of colleges and universities, and two 
earlier studies by Bowen and Minter (1973) and Lanier and 
Anderson (1973) also use indicators to e^^amine the ftnancial 
conditions of higher education institutions, Jenny (1973) has 
also done extensive research on the development of indicntors, 
that can be used to assess financinl health, ^'^ 

Another interesting development is the service recently 
announced by the Laboratory for Data Analysis (I977)> a non- 
profit corporation located in Princeton, New Jersey. Through 
their FinanciaUGuidcpost Service, they will use Higher Eoucn^ 
tion Gerieral Infonnation Survey (HEGIS) and census data to 
provide reports to institutions on selected aspects of institutional 
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operations. The reports will contain trend analysis and 
show how the institution compares to similar institutions ^n 
the characteristics that are examined each quarter. 

In contrast to such ongoing or recently initiated cffoii^t 
there are many educationaJ data-gathering efforts that are mi 
designed to be long-tenn monitoring activii.es, but rather to be 
brief studies conducted to meet a specific information neec. 
While special, one-time research projects generally cannot 
provide the kind of data base needed for educational indicators, 
they can have a significant impact on our understanding of 
what it is we are tryii^ to measure. The work of the National 
Commission on the Financing of Postsecondaiy Education 
(1973) for example, represented a major effort designed to 
articulate a set of goals and to relate data to the gcals of 
postsecondary education. The finance commission's articula- 
tion of goals and the subsequent matching of data to these 
goals represented an iniponant attempt to relate postseeondary 
education information to the needs of policymakers. 

In addition to these major research efforts, each year 
dozens of other special studies are conducted by instiiutjon^ 
agencies, and individuals on topics or variables important t<^ 
our understanding of educational processes ahd^iucomes. 
Unfortunately* however, potential users of these data may find 
it diflficuU cither to find a study or gain access to the data 
contained in it. Additionally* each of these efforts looks at the 
educational system from its own particular perspective, using 
its own data collection instruments* data elements, and defini- 
tions. Thus* attempts to integrate the various studies to obtain 
a more comprehensive overview of education becomes an 
almost insui^ountable task and one which no one has yet been 
able to accomplish. 

Far too often, problems in using dsta ^tie not related as 
much to access as they are to the ^t that the primat^ emphasis 
is placed on the collection of data rather than on insunng that 
information can be derived from the data that are collected. 
There has still been far too little effort directed towards de* 
tennining how this data iDight be more effectively focused on 
the specific areas of concern to educational decision makers. 

Agenda For The Future 

Given all the activities described, why, it ir-'^m be asked, 
shoukl we be concerned about the development of postsecondaiy 
education indicators? Is there not enough going on? ' 

The answer, as you might sunnise* is no. While the need 
for postsecondat> education indicators and an interest in their 
development has^dc^jy^acceterated, there remain critical 
components and aspects that are not being addressed in present 
activities. We lack r overall framework for indicators, aiid~ 
as a consequence, me specific work that is carried out ex- 
periences little cross-fcnilization and moves us aw^y from, 
ratlier than towards* consensus. While we understand the need 
for indicators very well* we do not understand their roles and 
uses well at all. Nor havx: we obtained much experience, 
across individual projects, about the advantages and disad- 
vantages of different foim^ of indicators. ^ 

Progress in the development of indicators, therefore, will 



require the development of a framevvork that enables ub to 
understand oetter who the users of indicators are and how 
indicators might be used in decision making. It will require 
n^search on the form of indicators and how the form should vaiy 
as a fm.^rtion of use and users. It will require a carefully 
stuctu^k.^ eonsensuS'building process so that the parties to 
pvMsecfind.v> decisionmaking wilt have confidence m what iS 
beii^ coimnunicated by the .,idicators* And, finally, pro- 
^.(iarcb for the use of indicators in the plannmg and decision^ 
makit^ process of post$ccondat> education will need to be 
developed. , 

It might be argued that different indicators are required to 
facilitate the planning and dee csion- making process at.each of 
these levels. Unlike the economy, wheie national policy tends 
to dominate state policy, policy for postsccondary education, 
and to an increasing degree, for private postsecondaiy educa- 
tion, is derivative of slate government. Very much like eco- 
nomic policy* however, the provVlers of products and services — 
postsecondary institutions — are affected by the actions and 
policies of the federal and sta^ governments. A conceptual 
framework that enables us to understand better the need for 
and uses of indicators among the various postsccondary decision 
makers is an important necessary Qrst step to achieve progress 
in the development oF indicators. 

Research nec^saiy to achieve such progress would focus 
on the various fonns that indicators might take and the avail- 
ability of data to support those indicators that are needed. This 
is a large and important task. It is conceivable that much of the 
infofmation needed to stipport the deveJopment of postsecondary 
educatior^ indicators can be provided by thn U.S. Bureau of 
Labor Statistics, U.S. Bureau of Census, and other data collec*^ 
tion agencies. But it is also true that NCBS, theinajor collector 
of education data, will have an important role to play. And 
based on the experience of NCHEMS and othsr users of 
HECIS data, there are serious problems with the reliability, 
validity* and availability of current NCBS postsecondary edu< 
cation data collection activities (see McCoy, l976a, and Jones, 
Kaichian* McCoy, and Orwig, 1977). Continued research is 
necessar^^ therefore, to deicnnine the extent to which presc .1 
data collection efforts will support the development of indicators 
and to identify needed modifications in present data collection 
procedures. 

The need for consensus cannot be overestimate^' At the 
same time> however, neither can it be achieved ovemtght. 
Consensus cannot be arrived at by a national conference* an 
NCHEMS or ACE Task Force, an article in Change magazine* 
or any other single activity. On the other hand* it probably 
Cannot be achieved without them. The road to consensus will 
be a dtflficult one with false starts, niistakcn judgments* fois- 
traied research, inadequ^^ data, and philosophical differences. 
Yet, to ignore the need tor consensus about the form and utility 
of the indicators is to deny their eventual use. Consensus 
repiesents a kind of <:onfidcnce, and it is confidence ir. the 
need, fonn* and utility of indicators that will lead to their 
implementation. The task of developing indcators is one in 
which we all have a role. Certainly, we all have a stake. 



^ Footnote 

*Utin£ ihc t^^^mk analug> that ha^ been purutcd av ulbci poru ^iflbc papci. mkr^ iiHlhatot^ foi piAti«cotH)d]> ciJucatiun i^ifhi be hkcned tv the finarvial latio analjr^j^ 
Uiai is employed by Standuid and Poon and others 10 Anatyie slock orfeiinigit. 



INDICATORS 



References 



llauer, R. Si>Ciat indkaton. Combndgc. MA: The M.1.T Pre$s. 1976. 

Bowen, H R ^ Mhter, W J Privafc hightr tducation. fir.t amutat rd^rt onJinanttiJ twd tdwaHottat trends in the prtvatt sector ofAmtnifm htghtr tduiQUon, 
Weshlr^toitp D^C; Association c>r An^cait Colbges. 1975, 

CAfTOll. M Anadapfatton offincttitwlana^i^suthightrtdtuQiKM^^^^^^^^iip^V^^^ Buul(ter.CO. NaiicmalCcnterfot Hifber EduLaiionManagcmcPtSysiem^. 

CoJricr, \>} Th< dtttminaum of inttUufipiuji finwtctat dittrtss A proposat dttigrted for the rteeds of drciuon makers staff paperJ. Boul<kT. CO. National 

Ctatct for Higher Education NtaiugenKnt ^ystenur 1973. ,■ 

Gboay. L ind Khldcrr Suttt tt^ support of htghtr tdvcatum. Rtvcnue appropnatums minds aiut poutrnsr <R«poft No. 47)r Denver. COr Education 

Commission of chc StaicSr 1974. 

Granny, t and Ruybr J Suxtt tux support of htghtr tdttiitttoit. RtvcAW approprtattons trtndt and patttnu. fp63-75. 6etke1e>, CA. Centei for Research and 
D«velbpn)eni in Higher Educationr 1975. 

Cooler D Dtvtlopmenf twd use ef edtKUtwtat tndttattfFJ A piaper presented ai the Annual InvJtationaL Conference by the Educational Testing Servh^. New Yorl. NY. 
1975. ^ 

Ha)ttea<!t K.D. Sutttvflde pUtnntng it\ hishtr education, WaihinSton. p.c: U.S, Govenmieni Priming Office. 19^4. 

Halstead* K D Hightr tdttcation prttts atuS initxts (U S. Depanmeni ol Kcalihr Education and Wclfaie pubttcation No. OE7S'i700i5>. Washington, p^c.. tr,S. 
GovemD)cn( Printing Office. 1975. 

Jenny. H h tllgher education finance HeatUianddisuvj^. Inf^mufmri^p^rljQrnpoiuecvitd^ry^c/maftafl^ TAemrrfh/^r^lfffnantri. J-f^-Hugt^&O. Mills ^£ds.> 
Wcishlngion, D^C*: American Council on Education. 1975. 

Jones. DP , Kaichian, A . McCoy. M .ztidOr*n\%.\AS>.Statt-Uv€ttt^0T7nattonbase. fir/rfffvtew«fmm (Technical ReportNo.85>.Bouldet. CO. NaiionalCenierfw 
Higher Educaiion Managenteni Sysiems. 1 977. ^ 

Kaiz, A and Miller, H ittdicautn ofiht ttait of iastUatiims of btghtr edttcatton (rcseaich now/. Trenton. N.J.L Depaiunem of Higf(*cr Educaium. 1976. 

Labonttoiy for pata Analysis. On mfasttringfiitanciat itrengthi of totkg^t ortd ttniwrsititt. Prtncetonr N.J.: ^uiborr 1977. 

Lanier* L H and Anderson. CJ A sttidy of the fmattcifd condtiton of ^<^^^g" antvtnlitti. Wasliir^ton. D.C.. Amenean Council on Educaiion. 1975. 
LufHon, A.H„ Augenblick. J., and Hcyison. J. Die Tinancial siaie of education. Oton^t. Sepieniber 1976. pp^ 21-38. 

McCoy, M and Jooc&. D Federal level needs assessment for poststcondary edvcaiton (Internal staff paper)- BouMer. CO. National Center for Highci Educaiion 
Management Systems. 1977. 

McCoy, M StattanJ iocat flfUxnciQl support ofhtsher education* A fr^uaework for tmerstare eomp^rtsoTS—t972-^7S. Ftetd revtew edttion. Boulde/. CO. National 
Cemer for Higher education Managen^m Systems. ]976.(a) 

McCoy, M Sutttand local finandaf support of htgher educattm. A ftanuwork for tnterstare eompartsons^t97S-74r Fteldrevtew edtttoitr Boulder. CO. Kaiional 
Cciner for Higher EducatEon Management Systems, I976.(b) 

National Center For Educational Statistics. The condition education. Wftshiitgtonr D.C.: U.S. GovenunemPrintingOffice. 1975. 

National Center for Educational Statistics. The condition ^ education. Wa$hinigton. (XC' ^-S- Government Ptintir^g OfTioct 1976, 

National Commissktn on the Financing of Posisccondaiy Education. Ftnanctng postsecottdary education tn the United Statts. Washington. D.C.r U.S. Government 
Printing Office, I97X 

National EdiicatVon A&sociaiionr Research Qivitior. Raniins of the states, t97S. WashingK^n. 0X1.. U.S. Govermnem Prtntlr^g OfUce. 1973. 
Van Alystyne, C. and Coldrenr S.L. Ihe fbumcial measures project. Washington. p.C: American Council on Education. 1976. 

\^KA^<atJ^.Soune s of finant.iat support for higher education tnstttuttons^ 1972 Boulder. COl NationBlCentcrfor Higher Educaiion Management Systems. 1970. la> 

^ — — ^ „ _^ ti 

Weldon, K ^ut<es of finant,i^l support for Higher ed]t^aiv>niTatniiiiim!i.— i9Ji -74 Bouhkt.CO National Ceiuei for HigheitdutatioaManagjemeiu Sysiemst 1976. ^bJ 

Wlkox. L D. Broofcs, R M . B^1.G.M,.& Kknighn.G.E. SoctaUtuhcatorsondSoaetotnto.utonng. Anuni^>t^edh\hiio$rapkf.Svn^t&^\tcxi^}<J^y.'^^^. Inc.r 1972. 

Wynn, G^R fnflattott tndtcaiors in liberal <^rts iolkgts {Dissenation. 19^4> University Micronintt No. 75-1399. P.Oi B^x 1307» Ann Arbor. Michigan. 

Wynn> G R //^/toJion in the hgher tduMtion mrfturry (Ptofesstonal fik. <Hl). Wash^ngtoi.. DXI.. National Associ^ion of Colk^ and Umversuy Busirke^ CHTicerst 



125 

134 



SIMULATION MODELS FOR PLANNING 
IN EUROPEAN HIGHER EDUCATION 



K. M. Hussain 
New Mexico State University 



Simulation was used for planning in North America in the 
middk J 960s with CAMPUS (Comprehensive Analytical 
Methods of Planning in University Systems) and RRPM (Re- 
source Requirements Prediction Model). This was followed by 
immerous Other models, including CAP:SC/SEARCH and 
HELP/PLANTRAN. In Europe, the use of simulation came in 
the early J970s with models currently being, developed and 
implemented. These developments in Europe were largely 
independent of those across the Atlantic and even independent 
of each other. To one important extent, they represent con- 
siderable conceptual innovation. Also, some of their submodels 
have relevance to North America and are portable. As such, 
they should be of interest to the researcher and modeler in 
North America. Identifying the relevance, portability, and 
conceptual contributions of^the European models is the objec^ 
ttve of this paper. These models are described in terms of their 
development, their basic logic ar^ jcope, their plannihg-refated 
modules, and some implementation features. 

The di^ussion is mosdy z comparative one addressing 
the American audience and emphasizing the differences with 
American models, especially the most comprehensive CAMPUS 
and the most commonly used RRPM. 

European Simulation Models 

Implementation of simulation models in Europe was pre- 
ceded by considerable theoretical work. This included work by 
Bemaid (1^67), Bessai, Elsiennann, Uitz, and Redelbeiger 
(1969), Caspar, Bayer, Btngest, andBlahusch (1968), Dietze 
(1969), Finkinstacdt and Redelbeiger (1970), Criese (1970), 
Menges and Elstermann (1970) and the OECD (1970). But 
none of this work resulted in implementation. When asked for 
reasons, one of these authors replied, "because we in Europe 
do not have the data base required by such models; and ftinher, 
95%jof our budget spending is determined by the government. 
The remaining 5% represents nongovernmental decisions. 
Why do we need a model?" 

This was true tn 1^71 and is still largely true in many 
European countries. But of slate-funded universities, some are 
new and less constrained while others are very old and have a 
tradition of Hscal autonomy. Both types have developed and 
are using simulation n^odels for iong-rangc planning. Some of 
these models are restricted in their use to only one institution. 
They include the models developed at Bilbao, Spain, and at a 
univershy of Scotland. Others have been extensively used 
within One university (e.g., the TUSS and MSAR model) or 
have^becnused in more than one institution andcountiy (e.g., 
the his' or GERN'modcIs). 

HISModel 

Tlic HIS model is nanKd after the organization that de* 
vclopcd it— HochschuMnformatiOn System in Hanover, West 
Gcrfiiany. HIS was Hnanced in its Hrst 4^ years by the 
Volkswagen Foundation and is now supported by the Lander 
(states) and the federal government of West Gcnnany. 

The HIS model is currently being used operationally 
(Hussain and Frcytag, 1973) by the University at Karlsruhe but 



has also been mn at some other universities in West Cennany 
and in Austria. 

The basic logic of HIS is shown in Figure L Jt is very 
similar to that of CAMPUS and RRPM in the ^United States, 
and even the other European models TUSS and MSAR. tike 
other European models, HIS added on the cost components 
(boxes 1 1-!4). These are not an integral nor a veiy significant 
part of their models since the Europeans are not as concerned 
with costing or unit costing as are the Aniericans. 

The HIS model, lik^ CAMPUS, is at the dissaggregated 
level ofthe activity (such as a lecture, lab section, or seminar). 
HIS, like the other European models, does not have the detailed 
richness of planning variables (such as substitution of faculty 
or space, hiring and sabbatical policies, and administrative . 
loading), which CAMPUS does. Nor does it have the modules 
of faculty flow, budget review, or revenue. But HIS does have 
two submodels that are unique to both' Europe and the U.S. 
These are the optimal assignment of faculty and the capacity 
module. 

The Capacity Module 

All the planning models discussed in this paper are con- 
cemed with the resources required for a given student enroll- 
ment. The HIS model, in addition, is concerned with the 
reverse question: given a resource capacity constraint (faculty 
by rank within each discipline and space capabilities), what is 
the maximum student enrollment in each instructional program 
that the constrained capacity can support? 

This question is of great relevance to Cennany which has 
an upper limit on student enrollment (numccus clauses) in a 
number of disciplines. In these academic programs, the capacity 
module detennines a ceiling enrollment. This ceiling could 
possibly be increased by changing planning variables in the 
resource generator and even the ICLM (Induced Course Load 
Matrix). Finding such a solution is one of the ways the resource . 
generator is used. ^ 

The flowxif the capacity module is shown in Figure 2. It 
reproduces the start and end ofthe resource generator ()k)xcs 1 
and 3 in Figure 1). The capacity module starts with the 
calculation of faculty fulMime equivalency (FTE) required by 
each rank within each academic department. The module then 
detennines the utilization of faculty and of space calculated by 
a speciHc algorithm (box 15, Figure 2). This utilization then is 
compared with desired utilization levels as stated by policy 
parameters (box !6). If the comparison (box 17) shows that the 
utilization is less than the desired utilization, the YES exit of 
box 17 leads to.box IS, where the student enrollment is 
increased. The model recalculates the new utili2ation (box 15) 
until the utilization is equal to or greater tlian thc dcsir^djevel. 
Then the NO exit of box 17 leads to printing the new value oT 
enrollment (box 19). 

The final solution is important not only for institutional 
planning but for national planning since the enrollment ceiling? 
are input to a national student assignment model. This ntodcl 
assigns students to speciHc universities, allowing for variables 
such as student preference, state of birth, time of application. 
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Figure h Basic logic for resource allocation models. 

and academic achievement in addition to quotas for the handi- 
capped* foreigners, and army applicants (BockJing, 1973). 

The capacity module is of less interest at the moment to 
universities in North Amefica because they do not have the 
same problem of undercapacity that exists in Wesi^m Germany 
and other countries in Europe. But even in North Americai the 
module may have application in ccitain sectors^ such as medical 
schools, where capacity is constrained. In any events the HIS 
model should be of interest to model builders because the 
algorithm reduces the number of iterations needed for a solution. 

Optimal FactiUy Assignment Module 

Tins Optimal Faculty Assignment Module, described in 
Dcttwctlcr and F(cy (1972)* is unique to the HIS model (version 
A). It requires as input the identification of each activity that 
each faculty member can teach and the maximum contact-hour 
teaching load of each faculty. It then optimally assigns faculty 
to each activity for the.contact houij that need to be taught as 
determined by the contact-hour generator of the resource pre- 
diction model, subject to the maximum teaching load for each 
faculty member. The module then identifies the shortages or 
surpluses of faculty resources for each activity. 



The association of required faculty to activity is not made 
in the other models where the faculty needs are calculated for 
the entire administrative unit of instruction* such as an instruc- 
tional department. These models assume the substitutability of 
faculty within the department. This assumption may be valid if 
the shortages or surpluses of faculty are in related teaching 
areas. But the aggregated faculty ealculation is not conducive 
to specific control of faculty hiring. It is theoretically possible 
for a department to hire new faculty in an area which is 
overstaffed, using funds meant to hire faculty in an area 
whet« iUcte is a shortage. Ac a results the next year the latter 
department might still be short of faculty in one specialty even 
without an increase in student load. The HIS model avoids this 
possibility* for faculty shortages are specifically identified hy 
kinds of activities that need to be taught^ and hiring must t>e 
donc^for those activities. The models therefore, serves as a 
control in the hiring of new faculty. 

The optimal faculty assignment module can be used in- 
dependently of the institutional resource model at the depart- 
mental level. The effect of changing planning variables (such 
as faculty loads and faculty teaching capability configurations^ 
including those of prospective new faculty) can be simulated. 
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Figure 2. Capacity module. 



Also, the module can account for faculty preferences for 
course assignments in which case the shortages jwould reflecr 
needs that emerge when faculty teach what they preferto teach 
rather than what they are capable of teaching. The mcxiule is, 
therefore, iisefuj for planning at the departmental level in 
addition to the institutional level. 



TUSS Model 

TUSS stands for Total University Simulation System. It 
is essentially a resource prediction model designed for the use 
of the University of Utnxht, th^ Netherlands. Its first version, 
TUSS-I, was implemented in 1970* TUSS-3 is the current 
version and is at the more disaggregated level (activity level). 
It is this version that is also being implemented at the Uni- 
versity of Geneva in Switzerland. 

Like all other models previously mentioned, TUSS is 
student driven. But instead of one student flow model (box I 
in Figure I) the user has a choice of one from three: the firsr 
uses the Markovian chain* the second is a multiple regression 
model, and the Ihird is an ad hoc model. 

Given student cnrallment in each activity, the model 
calculates the faculty required Howevcri like most models, it 
does not use the ICLM. Instead, it starts with the hours spent 
by each student (in each field of study) in each curriculum 
year> These are policy or endogenous variables. These are 
distributed into scheckiled hours and unscheduled hours by 
ratios which aie also policy variables. The scheduled hours are 
lectures where class size is insignificant; seminars or recitations 
where class sizes are significant; and finally^ laboratones where 
class size and equipment is significant. ITie unscheduled hours 
are hours spent by the student on individual work such as 
reading, venting, internship, and examinationsi The calculated 
time spent in each type of instni'ctional activity b^ smdents is 
Ihcti multiplied by the ratio of faculty contaer houf3 to student 



hours for each instnictional type. This is divided by class size 
(where elass size is significant) and faculty load (which gives 
the number of faculty required). ThereaHeri the calculations 
are conventional as shown in Figure I (box 2 onwards). 

The space calculations in TUSS (boxes 5-7) are con- 
ceptually like those in CAMPUS and RRPM except that they 
are more comprehensive. They include related Itesources of 
equipment and are more extensive in scope. Most important is 
the inclusion of libraty space which is a function of all users of 
th"^ library, teaching staff, nonteaehing staff and students. 

The total space requirements are ealculated according to 
urban areas. This is unique to TUSS because of the nature of 
the location of the University of Utrecht. It will eventually be 
housed in a large j^odem campus now being built on the 
outskirts of the town of Utrecht. Meanwhile, many of the 
classes are located in buildings in downtown Utrecht as are 
some of the offices, including the Office of Planning that has 
developed and maintains the TUSS mod^t. Therefore, space 
(and equipment) calculations are done for each urban area and 
for each planning period according to specifications stated as a 
set of policy variables. These specifications identify the depart- 
ment that should be housed in each urban area. Ideally, this 
reduces the walking distance and travelling time for personnel 
getting to work. 

; The space requirements, are compared with space inven- 
tories (box 11 in Figure 1) in the university data base. This is 
done manually for mof'. models including RRPM and some 
versions of CAMPUS. 

Space is a constraint in detemnining the admission ceilings 
for ntmerus dausus as incorporated in the HIS model for West 
Germany. But in the Netherlands, in addition to th<^spaee 
constraints, teaching staff availability is used to determine the 
ntim^rus dausus ceilings. The available leaching staff is de- 
Icimined exogenously, and after the simulation of resource 
requirements is made by TUsS, this staff is distributed over 
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the disciplines. This distribution then determines the staffing 
eonstraints for admissions by eaeh diseipline. 

A final imponant feature in TUSS is its emphasis on^ 
training users of the model. To aehieve this, a training mod^i 
of TUSS eailed U5^G: University Simulation Game, has been 
designed (Hussain, 1977). This game has been used to train 
(and involve) not only administrative users of the model but 
also students* beeause they take a veiy active role in university 
administration in the Netherlands. 

MSAR Model 

MSAR (Model of Simulation and Allocation of Resources) 
was designed and implemented in 1974 as a response to a 
decision in 1973 of the government of Portugal to locate the 
Univeni^ade Nova de Lisboa in the outskirts of Lisbon* with 
an enroliment starting at $00 in 1976 and ^wing !o 10,000 in 
19S5. The go vemmenr wanted this university to experiment 
with different eunieulum and techniques cf instnietion. In 
planning of such a university, the rector asked many 'Vhat-if 
questions. To answer sueh questions* MSAR was created. 

MSAR essentially is a set of two submodels as implied by 
the conjunction in the title. One submodel was for space 
planning thaf would simulate different mixes of space types 
given different planning factors such as space used for student 
or staff, constfuction cost coefficicntSt multiple use of space, 
etq. Another submodel was to simulate different mixes of 
personnel given different planning factors such as faculty 
loading, staff loading, teaching techniques* class sizes* in- 
struction types, etc. 

Conceptuallyt the two submodels follow the basic calcu- 
lations of CAMPUSt HIS.-KRPM, and 7VSS which were 
studied carefully before designing MSAR. The main vanatlon 
was the adaptation of the faculty calcubtion to the'umque 
conditions in Portugal: overtime is allowed for certain ranks 
and only certain ranks can^teach labs and seminani 

Another variation concerns the estimation equations on 
personnel MSAR calculates personnel requirements not only 
for maintenance personnel but also for specialized types of 
mstnictjonal personnel such as lab assistants. Making lab 
assistants a function discipline* number of students* contact 
and type of instruction, is elegant, but it raises questions about 
the feasibility, validity, and benefit-cost ratio of using such 
disaggregated estimation. equations. This decision on disag- 
gregate equations was made in spite of the experience of 
implemcntors of RRPM 1.3 which showed that the user pre- 
ferred aggregated estimation equations to the detailedones that 
' used elaborate statistical packages for determining the necessary 
coefficients. It would be interesting, thereforet to follow the 
experience of MSAR in this respect, 

MSAR was designed and implemented in one year* a 
relatively short time forsueh a comprehensive planning model. 
There are at least two explanations for this. One is that MSAR 
had top management support. The rector had a planning back- 
ground and ha(i come directly from the National Planning 
Office for Education. Furthermore* he brought with him pan 
of his planning staff who were both knowledgeable and ex- 
perienced in modeling. Tht* staff was also knowledgeable 
about data processing and ensured that all the data needed for 
MSAR was Included in the institutional data dictionary. This 
was to ensure availability of historical data later to be used for 
model cocffieicnls. For the first few nms, eoeffieicnts were 
either nonnative or based on the experience of users of 
CAMPUS, HIS, RRPM, and TUSS. 

Another leason for MSAR's relatively quick success was 
that its designers adapted the basic concepts of HIS, CAMPUS, 
RRPM, and TUSS and then concentrated on its extensions and 
implementation. Their success would have been greater had it 



not been for the political revolution in Portugal resulting in a 
change of top management at the university and the freezing of 
funds for university buildings^ 

GERN Model 

GERN is an acronym for Generation of Resource Norms. 
It is still so new that its name has not yet been agreed upon by 
its designers. It has been implemented at the Unfvcrsit^ Catho- 
lique de Louvain* Belgium. It is currently being implemented 
at the University de LiegCr also in Belgium. 

Although the logic of GERN will not be dcscribe^l here, 
the main differences with other resources models will be 
Driefly mentioned. , 

GERN is essentially a resource prediction model* but the 
resource eocfficicnls (called K eoeffieients) are noijns (i.e., 
standards and prescrihed values). They are ncnnalize<l relative 
values (i.e.f 0 ^ K £ 1). They are determined by the plan^ 
ning committee that comprises representatives from eaeh faeulte 
(the approximate equivalent in the U.S. would be a college or 
professional school). 

GERN predicts on the facu.t^ level. The resources calcu- 
lated are what should be spent, and these are then compared 
with what is d^ired or predicted. Deviations are analyzed* 
adjustments made< and budget allocations then determined. 

The desirec^ or predicted re purees can be generated by 
GERN using a desired or hjsto.ical set of coefficients and 
variables. Alte mativetyt it can be generated by using RRPMi 
The RRPM model has been implemented using essentially the 
same data base as used by GERN as part of a postgraduate 
dissertation* Another dissertation is concerned with the adapta- 
tion and extension of both GBftN and RRPM for use at the 
University de Liegc- 

Summary and Concltssiotts 

The models of resource allocation in Europe and the 
United States have many common characteristics: they are 
cost modelst not cost-benefir models; they are simulation 
models* not optimizing models; they have mostly linear C()ua- 
tions for calculating their nonsalary ^costs andt thus, ignore 
discontinuities; they do not predict the number of new entrants 
to the institution nor do they relate it to manpower require- 
ments; and, finally, all are deterministic models (except for the 
probability matrix used in the student flow module). 

In scope and comprehensiveness^ the models in Europe 
are comparable to those in the United Statest though they do 
not have the richness of control variables nor do they have 
some of the submodels Of CAMPUS, such as the faculty flow 
model. The European moilcls arealsocost ^d costing models,, 
but in all cases these oom^nents were added as a separate 
modTule later. One reason is that the Europeans arc not as 
concerned with accountability as are the Americans^ Also* the 
Europeans have less resources for model dcvelopn^nt. This is 
especially true in the case of GERN, MSAR< and TUSS which 
have been developed entirely on institutional resources. HIS* 
on the other hand, like CAMPUS, did much of its'^ original 
development on foundation grants and is now supported, by 
federal funds (like NCHEMS). The shortage of development 
resources is not helped by the lack of contacts between the 
model developers. This is especially true of the developers of 
the HIS and TUSS models who did not know of each other's 
development even though they were separated by only a six^ 
hour drive by train. This resulted in some '"reinventing of the 
wheel"' which could have been avoided. It was avoided by 
the MSAR developers who adopted much of the basic concept 
of the then-existing models and concentrated on its adaptation 
to the local environment. 

The parallel and independent development of HIS and 
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TIISS wcrecostJy, but they contributed refreshing ncM^ approach 
to student load (TUSS) and submodels (HISK like the capacity 
model and the room^assignment model. 

The ^lJropca^ models have mnny limitations* but these 
are the ^me a^ expetiencod in America The systems provide 
no help in studying and improving the stability of parameters* 
ci;pccially the ICLM Also* no help is provided to the user in 
marching through the very lai:ge set of permutations of possible 
alternative strategies (both before and after the model is run). 
Search routines for identifying i^romising and nearoptimal 
strategies would gieally help thr jser Even the current output 
would help the user if it were packaged with graphics ihat 
^how trends and gradients rather than masses of numbers on 
sheets of paper. Reports could be designed that atso help 



management by eiteption in identirying mformahon and vari- 
ations that z\\ -ii allowable levels, Finallyf ihc models do not 
enable the user to calculate trade-offs directly. 

These Items are technological and Icehnical problems and 
can hopefully be overcome* given more time and effort. What 
is more important is the conceptual limitation for which there 
is less hope, problems of benefit identification and measure- 
ment as well as equitable and economically rational cost allo- 
cation rules. Finally* there is the problem with the user— of 
knowing the model* of knowing how to use it and how not to 
use lU and finally* of appreciating its capabilities and its 
limitations. There is need for work in all these areas if allocation 
models are to be used effectively both in Europe and the LI,S, 
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POLICY RESEARCH AND ANALYSIS: 
THE CHOICE OF MODELS FOR 
INSTITUTIONAL RESEARCH 



The intenl of this paper isto take acrilica) look at the role 
and functions of 'institutional researdi in determining policy at 
institutional, state, and national levels. The paper is predicaieJ 
on the judgment that institutional research continues to face an 
identity crisis and may still be floundering in its efforts to 
carve out a specific function in academic admunistration and 
governance. It is based also on the belief that policy research 
and analysis constitute acceptable models for institutional tc^ 
search that should be closely examined. 

Since the emergence of institutional research tn the early 
sixties, nunierous unifying or organizing themes have been 
suggested or advocated but, moie or less, rejected. Institutional 
leseaithers have shown a remarkable inabilit/'to agree on 
general concepts and priiKiples that y/oyHd give the ^eld or 
specialty a nomothetic basis. Institutional research has noi 
achieved disclplinaiy status in higher education* and no logical 
structure* conceptual framework,.or theoretical base has been 
established that clearly distinguishes institutional research from 
other forms of inquiry and analysts^in an institutional setting. 
Efibrts to deal with professional standards of training anil 
performance* or to define specialized roles and responsibilities* 
ha^ been sporadic and largely ujisuccessful. The enthusiasm, 
^capability, and generosity of institutional' research's **ftm 
generation" h^ve not been sufficient. 

Through it all, institutional research has retained its idio- 
giaphic chaiBcter. Institutiona] researchers remain a conglomer- 
ation of highly diverse individuals whose sole common ex- 
perience may be a concem with data collection and analysis — 
or an annual forum held in Interesting places. The data collected 
and analyzed continue to be institutionally specific despite 
enormotis pressure for comparability and statewide or nationat 
aggregation* Much of these data are not converted into policy- 
relevant information but remain incarcerated by computer or 
^ata processing equipment. At no time do the data approach a 
body of knowledge common to all members of the specialty or 
profession* The extent tc which institutional data are used in 
administrative or institutional decision making* policy formu- 
lation, or program planning is still dependent upon the assigned 
functions of specific individuals and the credibility they have 
been able to establish with peers and colleagues. 

This may well be as it should be. It is 'quite possible that 
the idiosyncratic features of institutional research should pre- 
dominate and that institutional research on any given campus 
should be what the president* top administration* orgoveming 
body of that institution wants U to be. This could explain why 
so many institutional researchers settle into supportive or tech- 
nical assistance roles for crisis ^managenfwnt* become con- 
sumed by annual budgeting c>'cles* or become conditioned to 
subsidiary roles as troubleshooters or anony^nous technocrats. 

Institutional research as an institutionally specific func* 
tion would not explain the continuing efforts of institutional 
researchers to establish a transinstitutional idei^tity. Self* 
preservation in ihc form of a friendship "to get the other 
researcher's data'' could explain a part of it. The insatiable 
appetites of state and federal agencies for data and information 
could explain the remainder. Vet^ there could remain an obvious 
attempt on the port of institutional researchers to communicate 
across institutional barriers and to establish some kind of 
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associational identification* to improve standards of training 
and performance within the specialty, and to achieve a more 
visible professional status. 

Models and P^dlgms 

TmC search for nomothetic dimensions may explain why 
institutional researchers continue to reject specialized roles as 
planners, evaluators, decision makers, experimentalists, or 
man^ement efficiency experts. The identity crisis of institu- 
tional research may require a continuing quest for professional 
identities that will eliminate stimulus confusion. Unifying or 
organizing themes may have been rejected because they were 
not indigenotis to the specialty and did not serve associational 
or professional aspirations. The more obvious themes or con- 
ceptual frameworks that have ostensibly been rejected by insti- 
tutional researchers are: (a) traditional modes of educational 
research, (b) measurement and assessment* (c) institutional 
and program planning, (d) systems analysis and organizational 
tHcoiy* (e) operations research and management science^ (0 
evaluation research^ and (g) econometric and sociological analy- 
sis. In each case, the advocacy of each theme or framework has 
apparently come from individuals who have entered institu- 
tional nfsearch from traditional or related disciplines, have 
been able to apply former tools and techniques with reasonable 
degrees of success, and have contended that institutkinal re- 
search would be the beneficiary if only better structure and 
discipline were imposed upon the specially or function. In 
several cases, the advocacy has been embraced wtih vigor and 
enthusiasm before **a cooling ardoi" encouraged institutional 
researchers to retum to doing whatever the dictates of other 
moments required. Whatever the residual effects* institutional 
researchers maintain an observable immunity to nomothetic 
forces. 

Educational research* As the older, more obviously 
related function, .educational research might well have in- 
corporated institutional research as a specialized subfunctk)n. 
That it 4id not do so is probably due more tOithe intemal state 
of affairs among educational researchers than to inherent forms 
of in^iompatibility between the two. Educational research has 
remained the captive of the natural sciences despite its con- 
tinuous infidelity to basic* experimental* quantitative methods 
of inquiry. Ed^tional researchers have too often dealt with 
practical, applied* mission-oriented problems with feelings of 
gutlt, even when prompted by necessity orfleeting moments of 
intelligent insight. Vows taken in pursuit of a science of 
education have seldom been foi]gotten for k>ng« and educational 
researchers have long been enslaved by a methodology that 
would ensure the eventual scientific status of their work. An 
ambitious effort during the sixties to redirect educational re* 
search to policy-oriented or policy-relevant concems crumbled 
when educational researchers of orthodox bent infiltrated and 
subverted the regional laboratories* research and development 
centers^ and other extraconvcnuonal agencies funded to free 
educational research from orthodoxy. The tragedy may be that 
educational research* after knowing moments of lavish financial 
support* tost most of the credibility it was beginning to gain as 
a means ofjnfluencing educational policy. 
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In retrospect, institutional rcstcmhers ma> be pleaM^d that 
their destiny has not been tied too strongly to thatof eduvational 
reseaith* If there were benefits in traveling together for awhile, 
those benefits were secondary to the demands of state and 
federal agencies for more and more data with whieh to justify 
continued suppon for postsecondai> education. (SccCronbach 
andSuppes, 1969; Rncher, 1974; Gideonsc, 1968,) 

Me&suremettt and assessments The development and 
assessment instnjmenti^ for institutional characteristics prami!>cd 
much in the early years of institutional researeh. Colleger and 
universities obviouSty have personalities of their own, and if 
valid, leltabfc measures of those characteristics could be de- 
veloped* the results would surely be a beneficial matching of 
institutions and students. Promissory notes were tssurd with 
confidence that we would eventually measure or assess the 
relevant dimensions of institutional life and character and use 
that information to facilitate the educational progi^ of students. 

The challenge to institutional research was to spend a sub- 
stantial ponk>n of its energy and resources on the development 
and use of measuring instruments and devices that would serve 
a science of institutions. What such instruments obviously 
needed was objectivity, standardization, and suitable norms 
for national and regional comparisons. Educational Testing 
Service launched a commendable effort to develop such inslni- , 
ments and to arrange for their commeieial distribution. The 
American Council on Education initiated an even more ambitious 
effort to assess and monitor the instituti on s/stu dents matc>)ing^ 
that were taking place nationally. The key to successful* 
interinstitutional cooperation, and to systematic inquiry of 
institutional structure and function, was standardized measures 
similar to those that had been effeci>ve in assessing individual 
abiliucs, interests, and achieve men is. 

In notable eases> useful instmmenis were devebped and 
have been used on a broad basis. Institutional researchers who 
have not used College and University Environment Scales 
(CUES)t Institutional Goals Inventory (IGl), or Institutional 
Functioning Inventory (IF1) have yet to cut at least one eye 
tooth. Yet there js reluctance to regard the measurement of 
institutional characteristics, campus climates, or educational 
environments a success. Many features of institutions remain 
obscure, indeterminate, or otherwise inaccessible to specific, 
quaiiufied measures. Too often, our colleges and universities 
have proved to be more complex than anticipated and less 
amenable tosystematic inquiry than foresight si^gested. In the 
face of it all, both students and facuhy became intractable as 
subjects of research, and the results of institutional studies 
became increasingly suspect. Mora than once, a mystique 
Surrounding the college or university has regained credence, 
(Sec Dressel & Pratt, 1971; Dyer, I966jl 

Institutional and program plannEiig. If institutional re- 
search began ^ a response to the grow^ and development of 
higher education in the late fifties and sixties, it may be 
contradictory to contend its relationship to institutional plannl.ig 
has always been strained. The failure of the Association for 
bistitutional Research and the Society for G)llcg^ and University 
Planning to find a common purpose and membership js in 
dicative of that difficulty, N^any institutional researchers have 
been active participants in institution^J planni^, and planning 
has been better from their participation. Yet there has been an 
obvious reluctance to identify too strongly with campus and 
facilities planning as those functions have been eondueied in 
many institutions. Despite the apparent dominance of space 
utilization studies at one time in the development of institu 
tional research, institutional researchers are not well perceivc<I 
as specialists or experts in planning per se. Even when the two 
functions arc merged in a common title at the vice prcsulential 
level, a cynic can suspect the position will involve a pre 



dominant^e of either planning or instituti^^nal restcart^h, but nut 
a happy maniage of both. Institutional planning per itC may 
remain an arena m which politicians, arvhitects, engineers, 
and others of constructive bent u^ntend — but not data analysts 
and empirical researchers, A cynic could argue with some 
force tha't^y the time institutional researchers amve on the 
scene, most important fJccisions have been made. 

What is true of institutional planning should not, but 
may, be Inie of program planning. Periods of uncertain growth 
or projected decline call forprogram planning no less intensive 
than those of r^pid growth and expansion. How successful 
institutional researcjiers can become in program planning for 
the future remains fo be seen. But there can be no doubt that 
many programs launched, without benefits from systematic 
planning, in the sixties are inadequate for the seventies. Pro- 
gram pruning mayjbe less glaniourous than program planting, 
but it could be more essential for institutional survival in an era 
of declining enrollments and increasing need to,^rve the 
demands and expectations of new or nontraditional students, 
(Sec Cope, 1974; Drcssel and Associates, 197l# Stewart, 
1971,) 

Systems analysis and organization al^lheory. Systems 
thinking has had a pronounced influence on the development 
of institutional research, and organizational theory has pro- 
vided insights and viewpoints that have been influential. There 
is still reason to question the level of sophistication in both 
systems analysis and organizational theory for a large number 
of institutional researchers vThe literature of the two specialties 
remains outside the mainstream of much institutional research 
and is seen as arcane by too many who borrow their concepts 
and principles without embarrassnfKnt, Despite the growth of 
statewide systems of public higher education, the uses and 
applications of systems concepts and organizational principles 
have taken some peculiar twists and turns. There isconsid<^ble 
hesitancy to let the influenoe of such specialties become too 
obvious, and there js, perhaps, even more ambivalence about 
their specific advantages or virtues. The outcome may be one 
in which systems analysis have made a transorganEzational 
shift to institutions of higher education and statewide boards 
orcoordinatingageneies without insisting on previous identities. 
Much of organizational theory has been resisted with the con- 
tention that colleges and universities art institutions rather 
than organizations as such. While some organizational prin- 
ciples might be applicable at certain stages of institutional 
development or for specific agencies on campus, the idio- 
syncratic features of both higher education and institutional 
research suggest that bows in the direction of specificity or 
uniqueness should he made frequently, (Sec Hoos, 1972) 

Operations research and management science. Much 
the same can he said for operatk>ns research and management 
science, Fbrays into institutional management and govemanv^ 
have been made by specialists from these two fields, but if 
they remain within the halls of AcadenfK, they usually find it 
advantageous to take the protective coloration of academic 
titles. Just as we might say that operations researchani manage- 
ment science are different because they each have iieir own 
professional association and liteiatun;, so wc might conclude 
that institutional research remains impervious to their influenu^ 
because most institutional researchers do n^^t belong to their 
professional associations and do not read their professional 
literature, 

A more acceptable reason might be that both operations 
research and management science are too highly specialized to 
serve the utilitarian needs of institutional research. Specific 
tools or techniques might be borrowed when appropriate, and 
certain concepts and principles may be common to all three 
fields, but for the most part, institutional researchers lack the 
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specialized skills and interests that characterize operations 
research and management science. In addition* each has hjxune±> 
in time, resources, and facilities that many institutional re- 
searchers believe to be missing in their own case. 

Evaluation research. The failure of institutional re- 
searchers to adopt an evaluative role and f^^ction is more 
difficult to interpret. Program evaluation would appear to be 
an overtcomponentofwhat fails within the baliwick ofmstitn- 
tiona] research, and, yet, the major thnist of evaluation research 
has come from sources far removed from offices of institutional 
research- While many aspects of evaluation have always been 
indigenous to education, and while institutional research has- 
occasionally been perceived as ''evaluation" i" another guise, 
the major impetus for evaluation research has comc from 
federal funding of larg^-scale programs in the arena of social 
action. For all practical pniposes, the effort may be dated from 
the inclusion of specific requirements for evaluation in the 
federal legislation of the mid*sixties. 

The relevance of evaluation research for institutional re- 
search should be seen in its differences from traditional modes 
of educarional research and in its immediate and direct applica- 
tions to much that uistitutional researchers do. For the present, 
however, evaluation research continues to be an emerging 
research specialty in its own right, while institutional research 
runs hot and cold on its merits. The management responsi- 
bilities of academic administrates increasingly require a con- 
cern with program evaluation that was not present in gn era of 
rapid growth. Several trends and developments in this respect 
imply that institutional researchers may become more and 
more involved in program evaluation, regardless of how much 
the]^,may prefer a, less adversarial role in institutional manage- 
merit. (See Fincher, 1973a; Rossi & Williams, 1572, Weiss, 
1 972-) 

Econometric end sociological analyses, Thcemphasis 
placed on educational outcomes and impact in the past decade 
has given strong impetus to econometrk or sociological analyses 
of educational effectiveness. Most of this research began with 
the Study of Eqtial Educational Opportunity (the G)lcman 
repod) and was accentuated by the Jencks study that gained 
notoriety sccond^only to that of the Coleman report. Most of 
this research calls to question the social and economic benefits 
of education* 

More closely related to institutional research arc a number 
of studies that question the economic bcncHts of a college 
education. Bolh econometric studies and sociological analyses 
have converged on pessimistic conclusions concerning the 
effectiveness of higher education in generating benefits that 
are both societal and personal Jf such research does not depict 
a model worthy of emulation by instiuitional researchers, it 
carries an influence on public policy to whicii instinitional 
research must be attuned and which instiuitional research 
should give a better response. 

Cost/cffectlveness or cost/benefits models are infiplied in 
many of the unifying themes or organizing principilcs that have 
been advocated for institutional research. The prominence of 
econometric and sociological analyses is particularly relevant, 
however, because of the tendency of such analyses to call into 
play a different set of assumptions for institntions of higher 
fjducation. Social and economic mobility has been regarded 
customarily as a by-product of a college education and not as 
its sok purpose, llic treatment of social or economic mobility 
as the dominant outcome of education leaves other purposes 
and functions unattended, (Sec Justcr, 1975, Solmon St. TauK 
man, 1973.) 



Policy Research and Analysis 

If the idiographic dimensions of instiuitional research 
have been dominant throughout its development, there is yet 
appreciable convergence in what institutional researchers do, 
the tools and techniques they apply in their work, and the 
nature and content of instituttonai studies conducted within the 
context of administrative affairs and operations. Many respon- 
sibilities and functions are increasingly oriented to what can be 
identified as institutional policy. While it is unlikely that 
institutional research will develop the theoretical base required 
for a science of institutions, there are obvious practical, applied, 
and policy-oriented features in its general composition and 
thrust. In brief, institutional researchers have clearly opted for 
a role in which they will^ not explain the nature and functions 
of higher education as a social institution but one in which 
what they investigate, study, and report will be directed to the 
improvement oi" institutional functions and activities. 

Policy research and analysis provides acohercut conceptual . 
framework that many institutional researchers will not find 
difficuh to accept. It also offers a context in which the profes- 
sional identity and interests of institutional researchers can be 
generalized fiom institution to institution. Whether institutional 
researchers insist on policy research or opt for policy analysis, 
as that term is sometimes used, will not be as important as tlie 
general agreement that the overall function of institutional 
reseatx:h should assist in the formulation of policy. For most 
purposes, institutional researchers can accept the distinctions 
that have been made between policy research and policy analysis' 
in terms of their varying emphasis on the empirical, systematic, 
technical features as opposed to a readiness to deal with 
logical, conceptual, problem^solving approaches. 

The advantages of policy i ^.carch and analysis as a frame^ 
work on background for institutional research niay be seen in 
distinctions that can be made in (a) the data base from which 
institutional researchers work, (b) the methods that are adaptable 
to institutional research as a specialized approach, and (c) the 
subject* matter domain of the field or specialty. For convenience, 
these distinctions arc presented in Table 1 as continuums on 
which policy researchisoriented to the upper end or the rights 
hand side. All distinctions need not be accepted to convey the 
general shifi of emphasis that is involved, and 
overlap or be redundant, 

^ As shown, the distinctive features of policy research are 
primarily a matter of perspective, emphasis, or intensity. The 
difference from traditional modes of research, cither educational 
or social, js seen in the shifts that have taken place in research 
ntethodology over the past decade or so. Some distinctions are 
similar to those that have been made frequently between basic 
or pure research and applied or mission-oriented research. The 
tendency to perceive such di^erences as all-or-none character 
istics, however, has sometimes obscured the fact that they are 
more often a matter of degree than a difference-of-kind. 

Data base. The dtstinctictis intended in data for policy 
research reflect the differences in method of inquiry and the 
overall subject- matter domain. The intent, nonetheless, is to 
show that a different kind of data or information is needed for 
policy decisions, that different modes of collection may be 
necessary, and that tlie way in which the data - -e stored and 
retrieved will vary from data that are-used in experimental or 
survey n^arch. The most important aspect of such data are 
their orientation to the needs ofconsumers or users that may be 
exterior to the policy under consideration, Experlir.cntal re- 
search, in contrast, usually specifies that data be collected af^er 
a problem has been identified^ a hypothesis formulated, and a 
particular research design carefully chosen or devised. Policy 
research is more likely to be conducted with data on flic but 
without the benefits of anticipating its usage. Another way of 
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saying this is. that the data base for policy research is more 
likely tct be administrative or statistical records that have beer: 
gathered for, other purposes. ^ 

The empnasjs on the credibility and fidelity of data or 
information in policy research should not be regarded asa sub^ 
stitute for its validity and reliability. Both credibility and 
validity are needed in policy research, but credibility comes 
into play jn policy research in a way that It does not in 
traditional modes of research. In the latter, valid» reliable data 
arc usually convincing; in policy research, a lack of credibility 
may completely undermiite the accef>tance of the research, 
irrespective of other standards of validity and reliability. 

Methodology. The intention of the distinctions in methods 
of inquiry is to show quickly that, when policy research is 
involved, the researchers are not conducting experiments. This 
is simply to say that thejr approaches and procedures are 
different because their purposes are different. They are nof 
testing a hypothesis as much as they are developing or demon- 
strating a possibility. The research effort will not prove or 
confirm any theory or hypothesis, but it may well demonstrate 
the feasibility or advisability of a certain course of action. The 
perspective is radically different, and a cynic has reasons to 
suspect that tndividuaTs trained in traditional or conventional 
methods of research wiU make the transition to policy research 
only with great difft<;utly. It might even be concluded, on the 
basis of experience, that it can not be done by most of us who 
were so trained. 

Subject-matter domain. The most important distinction 
in policy research pertains to the subject matter, content, or 
point of what we are talking about^ its relevance, or its nature 



and substance. Here the shift in pers^tive is more radical 
than in data or methods. Where traditional modes of research 
seek a relationship between antecedents and consequences, 
policy research is attuned to alternatives that arepermissable in 
the future as well as to their likely consequences. Where 
traditional modes work toward conclusions that v^ill explain 
some natural phenomenon or event, policy research hopes to 
derive recommendations for specific action that can be inter^ 
pre(e4 to unsophisticated audiences. In much the same manner,^., 
if traditional modes aim for a general theory that will answer 
the question how, policy^ research is concerned with choices 
and decisions tliat must be made in the present and in the 
future. The conditions may be given; the problem is which? 

In addition, there is an obvious difference in what is 
expected to come out of the process. Traditional modes have 
sought knowledge with the hope that such knowledge would 
conform to natural laws of one sort or another. Policy research 
is far less ambitious. It hopes to get a handle on the situation, 
derive an understanding or appreciation that may be unique, ^ 
and be able to q)ecify actions that can be planned or pro- 
grammed. The expectation and the outcome is different both in 
a subtle and in a complex manner. The good policy researcher 
is as hard to find as the good educational researcher. 

In closings let us hope that policy researchers will not be 
as difficult to find as educational researchers who know some- 
thing about both education and research. At the same time, we 
should recognize that they will not be found as often as 
institutional researchers. Several possibilities suggest that we 
are policy oriented, but we are not policy sophisticated— j^et. 
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A Schema for Policy Research and Analysis 



D^ta base 

Tbeoty-onented User/product oriented 

Concluston^riented t^. ,. .Decision- oriented 

NOrm- referenced Criterion-referenced 

Valfdity/reliabilliy Credibility/fidelity 



Methodology 

Experknental design , Quasi^xperimental design 

Classical sampling statistics Statistical decision theory 

Summaiivc evaluation , Formative evaloation 

Ptcdictlon as veriftcalion , . .Forecasting as instnimental 

Hypothesis^testing , Developmental-demonstnilion 

Subject-matter domain 

Antecedents lead to conse4iuences t .Mlemaiivcs lead to consequences 

Conclusions provitle explanations ^ Recommendations with imcipFCtation 

General theory answers how? Choices and decisions answer which? 

Nomologkal nets that are lawlikc , , Idiographk suuctures that are uniqye 

Knowledge as the outcome Planned and programmed action 
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RECENT ADVANCES IN ECONOMIC THEORY: 
THEIR RELEVANCE TO EDUCATIONAL POLICY 



Patricia Burden 
Univer ity of Wisconsin 



Univcrsily poJky objectives represent the siage bchveen 
conceptualization of theories ofcducation and their realization 
in plans or programs. This paper is based on the nolion that 
economic theories of c<Iucation can provide to institutional 
planners usefuJ insights which might otherwise be missed and 
that ati undciT landing or those theories can help policy maimers 
to be more efficient in the utilizatior of resources and more 
ef^tive in the accomplishing of objectives. A clear notion of 
(he major thconc;; provides a strong base from which to attack 
the efficiency questions faced by institutional administrators. 

It is usually ass*uned that planners are clear about uni- 
versity outputs as well as inputs, that they understand both the 
purposes of higher education and the processes involved in 
achieving them. Every admitiistrator and each academic has a 
theory of educatioti; that is. what its objectives are and how 
those- objectives are reached. The traditional view» on whieh 
most of modem higher education rests; is caile<l by economists 
the human capital approach It holds that education improves 
individuals by making them more pfoduetive and that in- 
dividuaJs undertake education beyond school because it ofTefS 
increased lifetinv earnings (arising from enhanced produc- 
tivity). An mvestmen* m human capital pays off in the future^ 
just as doesa worthwhile investment in physical capital. Educa- 
tion is agood thing because'it changes individuals iti socially de- 
sirable ways and etiables those individuals to increase social net 
output more than would otherwise be (he case. Individual output 
(and, therefore, income) is enhanced^ but spillover effects 
magnify the inipacts of education even more. The trained 
physician not only enjoys a hfgh income; he also improves 
public health* decreases worker absenteeism, reduces pain and 
suffering, and so on. Governments are willing to support 
higher education because they value the perceived net social 
gains from it. 

In contrast, theories of hfgher education recently developed 
by economists characterize the university as a njtcring mcch- 
atiism, the fundamental purpose of which is to sort and labeJ 
individuals for the job market. Universities do not change or 
improve students; instead> they provide employees with in- 
fotpiatioti- Insofar as this vidw describes reality (or elements 
ofit), the Implications for insiiiutional planning and adminis- 
tration are profound. This paper first reviews traditional ceo- 
tiomic theory of higher educalion (human capital) and then 
explains newer ideas (niieriogt tcstingt screening, self-setcction). 
Both educatlotial and policy implications are discussed, it will 
be argued that, eveti when the newer theories appear to have 
some validity in the prcsetit situationt universities serve a 
different but socially useful allocative function.^ 

Human Capital Theory 

The most widely accepted objectives of higher education 
arc based' upon a theory — the humati capital theory — which by 
the early 1960s had appeared in the literature of economics in 
wcll*dcvc loped form (Becker, l%4;Schultz, 1963). Itsdcfini- 
tive tenet is that education improves abilities, or job skills. 
Education enhances an individual's productivity. Expenditure 
on education is an Investment, in the same .';ense as capital is 



an investment — by foregoing present incomcgreatcr retums 
can be obtained in the future. Education builds human capitai* 
or productiveness. From the point of view of society as a 
whole, higher education removes students from the labor force 
in the short nint but these students are transformed into more 
productive workers in the long mn. Higher education m>- pre- 
sumed to enhance job skills, to ^d value to the person ex- 
periencing it, and, by doin| so. to increase ^gregate output. 
Therefore, society is willing to sacrifice imme'i»ate output for 
greater future output and, so, supports educatiou. 

Tile individual takes a different perspective with respea 
to higher education. Human capital theory says that persons 
participate in higher education as a mattcrof self interest. They 
want to increase lifetime earnings. Tliey are, other things 
being equals income maximizers and, in order to optimize 
future income, they ape willing to forego present earnings, to 
invest in themselves. They will continue to invest* through 
higher education, until the cost outweighs i\tc value of future 
payoffs they expect. In economic leniis, persons tend to invest 
until their marginal costs equal the expected marginal returns. 
Adam Smith's ''invisiblehand*' deserves a nod at this point. If 
each individual behaves in a selfish (income maximizing) way, 
social welfare will be maximized as well, as measured by net 
aggregate output, Future income will be optimized relative lo 
present in vestment expendtturet and earnings will be foregone. 

Human capital iheoty makes the job of thc*unive<sity 
quite clear; it is to add value tOt and to improve^ ihe student. It 
implies that the skills level is known when persons enter the 
university and when they lca\'e and that the latter should oe 
higher than it ^ former. Figure \ iUustnites this concept. If S 
represents the skill level necessary for successful degree com- 
pletion and an individual's ''learning curve'* shows the tm- 
piX>vement in skills overtime, the student who enters at time 
with a low skill level, S^, niuy never be able to reach 5. The 
more clever studentt say one who enters with skill level 5j, ex- 
ceeds S in time t- Tinte / is assumed >o equal three years in 
some countries (for example^ the United Kingdom) and four in 
others (the United States). Students with initial skitl level 5^ 
will reach 5 only if given more time; their achievements do not 
warrant a degree, but at the end of the three or Tot r year course 
their value added is represented by S^B. The value added to the 
lower skilled student is S^A and to the highest S^C. 

It should be noted In passing that society is traditionally 
elitist and chooses to open iiigher cd^ication lo those judged 
able to succeed (by earning a oegrec/. It may be the case that 
the value added by higher^ education to less capabk people is 
greater than that added to more clever ones. Higher skilled in- 
dividuals already have a relatively nigh marginal product, ^d 
more education applied \o them may increase total output less 
than would be the case if the same amoum of education were 
applied to the lower skilled;^ This does ,. >t mean the latter 
necessarily exceed the attainments of the fomicrt which is 
unlikely, only that the volume of value added may be greater 
in educating them; i,e. , S^B my exceed S^C, Insofar as this is 
the case, social welfare would be improved by educating the 
less skilled, and our selection criteria are all wrong. 
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Figure I. Value added in higher education. 



Figure 2. Alternative learning paths. 



Rgure 2 fommlizes a vpical planning problenit namely, 
cosl efficiency in Ihc process of building human capital. 
Assuming lhat 5 again represents level of achievement neces- 
sary to cam a degree and that the course in <]ucstion is one 
v;here all entrants have skilf level 5^; the course covers Ot in 
time. The length of the course is not a variable. Each of the 
learning curves along which students might move from 5^ to 5 
represents a different combination of resources (staffi space, 
equipment, and so on) ind to each of them is attaehe<I a set of 
ecsts- The academics and educational technologists must tram- 
late the learning paths into levels oTh ouite requirements so 
that the administrator-can cost each possible combination of 
inputs. One cannot rely on intuition tn determining which is 
cheaper; c«g,, the uppeimost path implies that students have 
high amounts of resources devoted to them early on, getting 
them to relatively/.high skills levds before half the course is ' 
over* after which^ perhaps, they work on their own a great 
deal- 

If time is a variable^ and cost levels attached to different 
course lengths can be considered, then the job is morn compli- 
cated. The learning curve may ha' c even more configurations 
Licausc U may vary in Ien£,th. If d single most efficient path 
can be determined for each relevant length of course* then one 
can think in terms of minimizing eosts in a time dimension, as 
well as educationally. Figure 3 illustrates that, in a veiy short 
period of time» costs of getting students to the required skiljs 
level for graduation would be very high indeed. If a course is 
made excessively long» costs become very high. Somewhere 
between* there is a time period that minimizes costs^ given that 
various educational methods have been eosted and the most 
efficient one chosen for each time period. 

Educational goals have been stated in terms of human 
capital improvement, and methods of building the required 
amount of human capital havcbecn determined by academics 
and educationalists. When these alternatives are presented to 
the administrator^ heorshe must find cost -efficient methods of 
fulfilling th& human capital goals. This specification of the 
problem Is deceptively easy because we have assumed clearly 
(Jeflned outputs and inputs. The policy maker will recognize 
,our justifiable folly. 

^ Human capital theory dictates that the job of the lecturer 
is to impart knowledge^ to add value to the student. The more 
education that is undertaken, the more the student knows and 
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Figure 3. Costs of education by length of course. 



the higher his or he^r skills level. Since university effPctiveness 
is juiiged in terms of how much value is addedi the teacher's 
job is clear. Tea er5 most increase the skills level of their 
students ^ .d» presuiii4ioi/» be able to measure the degree of 
success in so doing. 

And 50, the general human capital framework of vducation 
has developed. Society favors it because citizens improve their 
contributions to aggregate output* and individuals participate 
because it increases their expected lifetime incomes. Univer- 
sities accept students with given levels ofabilitics and graduate 
them later with higher levels^ lecturers provide the teaching 
resour<;e for so doing, administrators both organize the whole 
procedure and try to minimize its eost within the planners' 
framework. 

Screening Theory 

During the Jast few years, economists have developed 
newer models of education which are based upon different 
postulates and have enormous implications for university man- 
agement. Ttte essential and unifying feature of these models is 
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thai the university is 5C€n as an infonnatlon creatofi not as a 
builder ofproduclivity or tmnsfomier of students. The analytical 
development of Ihis appfoaeh is so new that it has not yet 
acquired a generie label; but a s<:reenUig theory of higher 
education (secSpcncc, 1972) WiW identify it to economists and 
will serve our purposes in this paper Variations of screening 
have been labelled filtering (Anow, 1973J* sorting (Stiglitz. 
1975)^. £:elf-selcction (Stiglitz), and testing <Bufdet^ and Mor- 
tenscn, 1976) Sueh theories are already firnily embedded in 
economics literature* but most educators and poli.y makers are 
not yet familiair with their elaboration and implications. 

The essence of the screening approach is that education 
improve^ infonnation about individual skill level. To illuninaie 
issues at hand, we assume in this section that higher education 
does not fulfill the human capital function. In eontrast to 
human capital's school of thoughts screening theory (in its 
simplest fonn) presumes that education does not improve 
individual skills. U serves instead as a sorting device. It 
provides labels for the capable, and its whole function is to 
determine who is, and who ts not, worthy of such a labeL 
Students enter the university with panic ular skills levels, and it 
is the job of the university to detennine, as accurately as 
possible, what those levels are, then to provide any potential 
employers with that information. According to ;his theory, 
education serves a useful function \ y improving infonnation ia 
the labor marketplace and. thus, facilita'es an efficient alloca- 
tion of resources. 

Empiricism in the Held of the economics of education has 
^o far been concentrated largely on correlating earnings levels 
with educational achievement levels, qualifications earned 
(Taubman and Wales, 1974). The c< .lelusioas are familiar: 
moie education usually means higher Income. But,^ if higher 
education is serving only a screening function, eamlngs pro- 
files do not look Very different A university degree signifies 
capability, which is also the case according to human capital 
theory So why bother considering new models with different 
objectives for higher education? The answer is of far greater 
significance — for the student, for employers, for university 
academics and administrators » for society at laiige — than just 
eaming profiles. 

If the university is only a filter, oTa sorter, its job is to 
separate the more capable students from the less capable ones. 
En its simpler fonn, filter theory postulates this as the sole 
function of higher education — picking out tliose deserving a 
favomble signal in the job market and awarding them the 
appropriate label. The introduction of self-selection enriches 
the analysis. A m^^or reason that higher education is a good 
filter (insofar as it is) stems from the operation of self-selection. 
By and large, more capable individuals arc drawn to the 
characteristics of higher education: the necessity for self- 
discipline, opponuniiy for study and reflection, the payoff to 
scholarly work. Universities '^n (and» of course* do) imple- 
ment policies which attract whatever sort is considered de- 
sirable The basic idea here is that the university fihers IfUlgely 
through the mechanism of self-selection. 

An uncomplicated model will illustrate sonfie of the impli 
catioiiil of the filtering hypothesis. Suppose that anyone who 
goes through the university obtains, afterwards, a wage of iv.. 
Individuals who do iiot go to the university receive w^, where 
(v, is greater than We assume that there are Only two types 
of individuals, skilled and unskilled. The former can purchase 
highcreducatiOnatcostc^,eost 10 unskilled isc^,andc^is lesg 
than , This can be explained in several ways, skilled persons 
can reach a partieutar grade point average with less effort than 
can the unskilled; or the more skilled simply like the education 
process belter. In the latter ca^, costs represent disutility of 
college attendance. 



Next, assume the following: 

u., - c, > 
- c; < 

This implies that only ^kkiilcd tndividual^k will go to the uni- 
versity. Note that tht^k model differentiates only between ^kkilled 
and unskilled, it dOes not yield ability levels beyond that 
distinction. And it is important that people behave as u they 
know how skilled they are. The university detennines costs 
(cjt c^)t which ean be any device that, is assumed to cause 
individuals to reveal skill. Course relevance is altogether un- 
important. What the university must know is what constitutes 
an operational screen for high- and low-skill individuals. 

Let us assume that higher education does, in fact» serve 
only as a sorter. The length of time required to earn a degree is 
one obvious candidate for change. Surely, three or fbir years 
are not needed to discover skill levels. Time spent in university 
could be drastically foreshortened, society could enpy the 
production of its skilled members at much less expense and 
without sacrificing productive activity dunng such a long 
educational process. 

A very recent versioa of the screening hypothesis views 
higher education as a testing process. The university still 
screens students and presents them to the labor market with 
appropriate labels identifying their abilities, but here thescrcen- 
iag process involves testing students. The job of institutions of 
higher education is to team as much as possible about in- 
dividuals by administering various tests to them. 

Another simple mod^l will illustrate the extensive, but con- 
trasting, implications of a testing thcoiy. Assume that all workers 
ean be divided according to two skill levels, one (5^) higher 
than the other (5,). [f there is no way foremployers to know 
the difference between the two before hiring them, then some 
wage {w) will be paid to all workers which is somewhere 
between a hfgher wage (iv,), which skilled workers could eam 
if their capabilities werel^nown» and iv^, which less skilled 
workers would be paid if their skill level were revealed. Waige 
is intenncdiary also because, in the absence of testing, all 
workers will tend to claim to bc5j, and since no signals exisi, 
the market wage will be more than but less than w^. 

Skilled (5p , Unskilled (5^ 
'iv^ > w > 

[f a testing mechanism exists (e.g., university), the more 
skilled persons (assumii.^ .hey know thdr skill levels) will 
undertake education if 

— c > >v 

where c fcpresents the eosts of education. If - c < »r, the 
less skilled will avoid testing. 

Skilled (5,) , Unskilled (5,) 
" C > IV > — c 

Thus» if a high-skill 5^ persoa is tested, he or she earns 
\Vy. [fa low skill person is tested, he o\ ^he cams Wj. With no 
testing, a worker eams If iv^ - c > w > ^i'/ - c, only Sy 
individuals will choose to be educated. Noie that the educated 
(i.e., tested) have higher tneonies and more skills, the unedu- 
.cated have lesser skills and lower incomes. In contrast with the 
previous simple model of filtering, testing ean provide a con- 
tinuous range of ability signals. Skilled individuals may use 
the university as a self-selection device, a way of revealing 
their true abilities. If it becomes generally understood that this 
is the case, testing itself becomes unnecessary, because only 
the skilled apply to be tested. The implications for higher 
education become rather worrisome. 

Further implications for institutional financing emerge. 
Might it not be reasonable to transfer some of the testing 
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function to the con imercial/ind us trial jccior? It seems liKcly their purpo!« to Icam from their Mui^^ni:^. not vice-vcr^a. The^ 

that, lor many careers, testing there might be preferable, and i( are expeeted to apply an aeeurate label, and so the flow of 

eould be argued that this would represent an e<iuitablc sharing information h reversed. They do not tiy to modify the Mudenis 

of testing expense Students themselves might well be more but, rather, to discover their respective abilities. The changed 

willing to bear testing costs; higher eUueation becomes a self educational mission of the university h*^ obvious implications 

selection mechanism for which the highly skilleU individuals for its administrative infrastructure. The concern of the institu- 

arc willing to pay, assuming they know their own abilities. If tional planner shifts from cost efficiency in the process of 

they know they arc good enough for a label — i.e., there is no increasing student productivity lo cost ef^ciency in information 

fifik element involved in testing- they will be willing to pay production processes. Is the traditional departmental structure 

for the process (assuming lifetime expected earnings are suf !^till relevant? Does the mie of the researcher bcconfie nfiore 

ficlently high) The fact is that whether education has built important? What criteria are relevant in selectmg Maff? On 

human capital or has simply identified talent is not easily what basis is the student accepted for testing? There are many 

discernible in the labor market. A university degree denotes <iuestions to be considered, 
ability, either way. 

Scum good examples of educational filtering do exist. Conclusions 
Oxford University, forexample* provides signals to the upper The objectives and the processes of higher education 

eschclons of the British Civil Service by producing for it today are clearly grounded in human capital theory. There is 

graduates whose university training has had little to do with little doubt, however, that the screening hypothesis describes 

their future wt^k'but whose <iualitics and skills are those some elements of the educational experience. Careful analysis 
desUcd by the Civil Service Oxford provides an accepted and , . of this approach provides valuable insights into the conduct of 

reliable filter* and the signal acquired there clearly qualifies higher education and encourages formulation of more realistic 

one for an income net of University costs that is relatively and specific organizational goals. Administrators who are aware 

higher than most incomes accruing to persons not so tested. of tile theoretical underpinnings of their work are more likely 

Insofar as the University functions as a screening mcch- to provide efficient support to the academic process — that is, 
anism, the role of educators changes a great deal It becomes ^ to achieve university objeciivest and todo so at minimumcost. 



Footnote 

^Thi> h\t point nrprcs^ntb the niajur tontntnitiOn uf 4;ti>nojni^i^^ treoUiiLnl^ ohhc :>tTt?Ding nuUun. The jJcj ii^cJf noijicw licnvK^tUid Ric^mant chapter J. SjnIonJ. 
chaptor hul )bc implKy.kHts. JfnvcJ f(um Ihc Jc%tLupincnl oitti c^onvfiiiL thcunc^. an:. In jjjihun. ihc nicthuJ of tummJjiuin nidk«^ pm^iblc mure rjtionji and 
.tppJicjiionv or the uki^^. 
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In this ''age of accountability," institutional researchers 
and others have become especially concerned about concretely 
identirying and undetstanding the impacts of their institutions 
on students »iid society. After two years of concentrated effort 
The National Center for Higher Education Management Sy$tems 
(NCHEMS) has developed an outcomes structure, a new system 
for organizing outcomes and outcome information for purposes 
of class ificat ion* analysis, a^td decision making. As conceived, 
this structure has potential use in helping institutional ofTiciats 
to identify educational needs, develop goals, translate goals 
Into more concrete objectives, evaluate the institutions and 
their programs* raise the awareness of institutional personnel 
about the need to rethink the outcomes of their institutions or 
programs, explore whether or not there are in^nant outcome 
areas that have been overlooked on campus, communicate with 
concerned publics about outcomes, etc. It does these through 
direct application to (I) defining outcomes, (2) origanizing 
outcome information, O) generating lists of priority outcomes* 
(4) classifying outcomes, and (3) storing and rctieiving in* 
formation. 

This paper gives an overview of the sUueture and reports 
on a project that attempted* in a preliminary way, to test 
application of the structure in small liberal arts colleges. The 
project was cosponsorcd by the Learning Outcomes Task Force 
of the Council for the Advancement of Smalt Colleges (CASC) 
and NCHEMS. It commenced in the summer of 1976 and ivds 
eontpleted in late winter 1977, 

The NCHEMS Outcomes Structure 

[n the early 1970s, NCHEMS stafT had developed an 
Inventory of Higher Education Outcome Variabhs and M^asues 
(Micck and Wallhaus, 1973) that consisted of organized lists 
of outcomes prominent in higher education,' along with defini- 
tions and outcome measures or indicators for each. This in- 
ventory was used at a number of colleges and universities in 
goat-setting and goal-translation efTorts and was tbund to be 
quite helpful Concerns were expressed, however, that it was 
not comprehensive ^nough, that it left out outcomes lhat are 
important to some people in higher education, FuTthcrmore, it 
was felt by many iHat the Instrument should focus on the whole 
of postsceondary education, not just on higher education, 
Theieforc, an effon was begun at NCHEMS in 1974 to develop 
a comprehensive structure for the outcomes of postsceondary 
education. 

Before trying to develop the structure itself, it was felt 
that agreement should be reached on thcquestiont Just what is 
an educational outcome? Various people seemed lo view out- 
comes in quite difTcrent ways, so it was fett that one definition 
of the word outconfic might not be enough for the structure, 
t^at the derinition might have to be adjusted for different 
contexts in which the structure would be u^. Theiefbret an 
extensive search of the literature was conducted to try to arrive 
at a concept for educational outeonfics upon which different 



people could agree and that would be especially appropriate 
for plannir^, managenficnt, and policy- development purposes. 
Concurrent with this, other comprehensive reviews of the 
literature were conducted to derive the following: (a) alt pre- 
vious attempts to structure educational outcomes and outcome- 
related concepts such as goals and objectives that are outlined 
in the literature, (b) all specific and general outcomes of 
postsecondaiy education that are speciricaHy claimed in various 
portions of the literature to be worthy of concern, and which 
could be used to test the content coverage of thv structure to be 
developed, and (c)ail principles o/ criteria that could be found 
in the literature of the field of taxonomy. 

The concept of educational outcome that was derived to 
undeigird the outcomes structure to be developed (and which 
is, thus, apart of the strueture) and the principles or eniena for 
developing and testing out the structure that came from the 
taxonomie literature are discussed in depth by Lenning, Lee, 
Micek, and Service ( 1977), A document discussing the nme 
than.80 previous outcomes classification attempts found in the 
literature (Lenning, 1977a) is also available. 

The concept of an ^'educdtional outcome^^* During the 
initial phase of developing ihc NCHEMS Outcomes Structure, 
a general concept of ""educational outcome'* was denved which, 
it was felt, most people could support no matter what their 
oriental ion —whether their concern is primarily with efficiency 
or whether it is primanty with effectiveness, Six general attri- 
butes (or characierist ies) of an educational outcome were 
formulated atorig with five (^her factors that are important for 
understanding what a particular educational outcome is all 
about. For an in-depth discussion of each attribute and factor, 
see Lenning et aL, (1977), 

The attributes of an '^educational outcome'': The six 
attributes of educational outcomes have been titled: foi~r 
change status, focus, neuu^ity^ measurability, and outf 
impact. Each is briefly described below, 

1, Form — This attribute of an outcome refers to the make 
up or substance of the outcome, that is, the forms in which 
particular direct oucomcs of postsecondaiy education, or eon- 
sequences associated ^vith_those direct outcomes, are ^or are 
intended to be) observed and/or measured. The three elassesof 
form are defined as follows: 

Product — ^Tangible, concrete entities that endure, cg,^ a 
program completer, a degree, a jobt or a book 

Event — Observablct tangible transactions or sets of be- 
haviors that do not endure with time, eg,, a seminar, a 
concert, a graduation exercise, and bcmg listed inMio'jMo, 

Condition — Int^Uigiblc but real circumstances, e-g,, 
morale, satistaetton, an attitude or bclieft an appreciation, 
social equity, and achievement, 

2, Change statu^This attribute was suggested by the 
extensive work of Derr( 1973), who developed a taxonomy of 
the social function of education that had a concept of change 
status as its foundation. Two basic change states arc possible: 
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Maintenance— OmXCOwcs ihat result in keeping the slalus 
quo, in stabilization, or in reproduction and preservation, e.g., 
helping a student to keep basie academic skills from becoming 
rusty or continuing traditions into the next generation, 

C^/i^f— Outcomes that result in alteration of the status 
quo; in modification, revision (improvement or otherwise), or 
replacement, 

3. Focus— Webster's definition of focus is *'a point to 
whieh something conveiiges,*' and this attribute converges on 
the basie, specifle whas that is maintained or changed to 
eonstitute the outeome of ooncem, (Another appropriate nanie 
for this attribute would have been aspect, as used by the 
SwedisK UGRU taxomoiiy of edueational objectives (Kling- 
berg, 1970],) To illustrate, instruction can involve maintenance 
or change on such entities as knowledge and understanding, 
skills and competencies, attitudes and values, appreciations, 
ttab:ts, roles, reputation^ gross national product, eedifl cation 
and licensure, jobs, income, family relations* social condi- 
tions, etc. 

4. Neutrality — The generic concept of educational out- 
come is a neutral one separated from any inherent value status. 
It is important that postsecondary educational planners and 
managers not let values cause them to ignore important negative 
or unexpected outcomes in their planning assessment, 

5. Measurability — ^Thi& attribute refers to the extent and 
ease with which a particular outeome or type of outeome can 
be quantified. Knowledge about measurabihty has important 
implications for outcomes identification, analysis* and in- 
terpretation , 

6. Output/impact— Output has often been used as though 
synonymous or combined with the term impact, and such a 
failure to make a distinction between these two important 
concepts reduces the ability to itl^ntify, organize, and analyze 
outcomes. DistinCtlons^jDimulated for these two terms are: 

Outcomes — The direct end products, events, or condi- 
tions that result from the application of the institutional or 
program processes to transform the various inputs, Examples 
for institutions are achievement levels, specialization of know- 
ledge, degrees, program completers, publication, and cultural 
events* 

/mpacrj— The consequences of outputs and eariier impacts 
for particular individuals, communities^ or things. They are 
the indirect end products of institutionalt program, or other 
activities and processes, Examples of possible (not assured) 
impacts for institutions include a program completer's increased 
ability to obtain and hold a job, the security and income or 
prestige that job gives the person, the increased gross national 
product that results (h)m increased income of individuals, the 
increased standard of Jiving and quality of life in society which 
may be associated with increased gross national product, and 
so forth. 

Other factors importani in understanding particular edu- 
cational outcomes. Although they do not describe the essence 
of an educational outcome, as the six attributes do, other 
factors arejif^t as important in understanding the outcome>and 
in applying outcomes information to planning, management* 
and cvoJuatlon; 

L ProducerffacHttator^Acimi^cSf methodst processes, 
programs, etc. that cause or influence the outcome to happen, 
or the conditions chat allow It to happen. 

2* Audience — The pctsons, groups, or^^izations, commu^ 
nitics, and other entities that receive or are affected by the 
educational outeome(s) of eonccm. Not delineating this factor 
often presents one of the major difficulties in identifying and 
understanding educational outcomes. 

3» Intended/umntended-^lSncxpKs^ as wdl as expressed 
motives for different groups desiring particular outcomes. These 



are important to consider in planning and management. The 
potential for unintended outcomes (both those viewed as posi- 
tive and those viewed as negative) should alstj be considered in 
planning, 

4, Functional area — The function(s) that particular out- 
comes can or do serve, 

5, Time — ^The point in time when the outcome occurs and 
how long the outcome lasts, 

A description of the NCHEMS oi!tcomes sfnicture. 
The NCHEMS Outcomes Structure has three formal dimen- 
sions, where an outcome dimension is a continuum that can be 
divided into segments along which outcomes can be placed 
and viewed in relation to one another. These three dimensions 
arc, (a) audience— the persons, groups, or entities that receive 
and/or are affected by (or that are intended to receive or be 
affected by) the outeome of concern—, (b) rype-of^utcome — 
whether or not the outcome involves a change in status (mairj 
tenanCe versus change) and the basic, specific entity that is 
maintained or changed—, and (e) /imc— the time frame in 
which the outcome occurs or is intended or expected to occur. 

Categories and subcategories (along with standard defini- 
tions and associated code numbers) are provided separately for 
the dimensions. For some purposes, at the institutional, system, 
state, or federal level, the amount of detail shown at the lowest 
level within a dimension will be sufficient. For many purposes, 
however, (and especially within the institution), additional 
levels of detail a^ needed. Helpful procedures for adding 
additional levels of detail to the dimension, for different pur- 
poses, are provided. Such a process is called ''extending the 
structure,'* 

It is intended that those dimensions and categories not of 
serious eoncem to a particular user of the structure be ignored, 
or modified and adapted in a way that will better meet local 
needs and situations. The same is true of the various proposed 
procedures for itsing the structure that are presented in a 
document especially prepared for institutional practitionen 
(Lenning, 1977b), Planners and managers at the system, statCt 
or fe<^ral IcveJ should also be able to make use of the proce- 
dures, and techniques outlined in this manual. Only some of 
the application procedures have been tested, and those in a 
preliminary manner, but the results thus far are positive. For 
example, the University of Colorado has developed, over a 
r^eriod of years> lists of student outcomes that their staff felt 
confident were comprehensive for their institution. The person 
yho coordinated the development of those lists was hired by 
NCHEMS to apply the structure to the lists^ using the appro- 
priate procedures in the draft-usen' manual, to see if there 
were any "holes/' To her surprise, several of what the Uni- 
vcnity of Colorado considered to be very important outcome 
categories had been left off of their lists. As a result, they are 
revising their lists accordingly, which in tum will result in 
some modifications i" their freshman student survey form. 

Only time and widespread use in a variety of different 
institutional and other settings will tell whedier the supposed 
potential of the structure will really bear fruit. Such use will 
also probably suggest modifications for future versions of the 
structure and adaptations in procedures that need to be made 
for different types of users and for difTetent types of institutions. 

Trying Out the Outcomes Structure 

Two approaches to outcomes identification and valida- 
tion, each using the NCHEMS Outcomes Structure in a different 
context, were attempted in the joint NCHEMS/CA^ effon. 
The NCHEMS approach emphasized identification and prefer 
ential weighting of outeomcst ordered according to essential , 
important, and less important outcomes. This weighting then 
led to questions of institutional administrators, departmental 
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cha[rpersons> faculty members^ and studcms about assessment 
and evidence issues Finally^ the discussion moved toward the 
identification of student activities and experiences which would 
lead to* precipitate or culminate in the achievement of the 
outcomes (Amajorrefincment of this approach that used onl> 
the most global categories of the structure was implemented 
Into the plannii^ cycle at one of the participatii^ colleges and 
was found to be quite helpful for cvaluatii^ their institutional 
and program goals ) The CASC approach* b> juxtaposition, 
was ciesigned to identify and specify learning activities that 
had three trails: 

I The activity was of a publicly demonstrable nature. 

2h The institution could exercise some control over the 
development and expression of the activity, 

3 The activity was expressed within a tinntb frame related 
to the ac(]uisition of skill or the attainment of an outcome. 
Once the acrivity was specified, the instrument elicited re- 
sponses which satisfied the criteria question and ideniificd the 
outcome sought though participation in the activity. 

Before eommcntii^ on the relative merits of, and reactions 
to, the approaches, the authors would like to address the 
problems or needs which suggested these approaches. The 
problems are the global nature of mission/goals statements* the 
translation of goals to operational objectiveSt and the need for 
determining a connection between what happens on campus and 
the raison d itre of the institution. Outcomes identification is 
an attempt to hypothesi2e'and realize causal linkage between 
what a campus expostulates as its mission and those changed 
behaviors for which the college can be held accountable. Our 
task force perceived a void between the all-embracing goal 
statements found in college catalogs and the methods of as- 
sessii^ student achievement— most notable of which arc paper 
and pencil exercises Henect the pivotal issue which our task 
''oree raised with faculty members is illustrated by questions 
such as, How do you determine if a student's critical-thinking' 
capability has been enhanced as a result of knowing the con- 
tent of your course? At the departmental and college-wtde 
levels, similar discussion took place to determine the activities 
which were perceived to bring about the attainment of intended 
outcomes. 

The centra] metaphor* As we were panieipatii^ in the 
ease exercise at one of the colleges* a faculty member raised an 
objection to the metaphor which encompassed our proceedings 
— the metaphor of a microscopCt which attempted lo isolate 
and identify rich and diverse acttvitrcs of an educational pro- 
gram His objection is also reminiscent of Kenneth Boulding's 
statement that measurement of teaching effectiveness is es- 
sentially "measurement of rapport,"" Funhermoret a faculty 
member at another institution objeaed to a mentality which 
did not value the spontaneous, ereativct and personal interaction 
between faculty and students which cannot be predetermined 
or assessed The approaches of both CASC and NCHEMS 
have been sensitive to these cont*ems and have attempted to 
integrate the greatest amount of latitude in areas of activity 
statements, evidence of achievement, and iniended outcomes. 
While the teaching enterprise is personal, spontaneous, creative, 
and idiosyncratic, it is also intentional intellectual activity. 
Our approach has been lo document what is intentional and to 
recognize our limitations regarding the spontaneous cnerigics 
released in the cduational setting. 

In addition to the metaphor of the microscope is the large 
question of whether colleges can be held accountable for 
attaining student learning outcomes At issue ore the dynamics 
of governance, pedagogical intervention* and value-added 
learning Governance issues emerge around the question of 
goal scttii^ and institutional aceouniability. In other words, 
must a Xanadu Coltegc graduate exhibit attainment of specified 



outcomes? Issues of pedagogical miervcntton emerge around 
student choice and the rites of parage as specified in the 
general educational, departmental majors, and college-wide 
requirements. The retreat from requirements spawned in the 
'60s is being reassessed toward the chary reinstatement of 
some common learning experiences. Finally^ the issue of value- 
added learning is central to the idendficanon and validation of 
student learning outcomes. Failing accurate and comprehensive 
assessment of student capabilities upon entry, colleges cannot 
expect to take credit for the promulgation of certain student- 
learning outcomes. Moreover, in the absence of input data on 
student capabilities, the assessment of specific activities which 
lead to outcomes becomes academic, at best. 

Results of the NCHEMS approach. Since diversity in 
intended outcomes was desire<I, it was decided to invite to 
participate small colleges that were diverse on geographic 
distribution, size, institutional controls nature of the student 
population (residential versus commuter and coeducational 
versus single sex), curriculum, and planning/management 
ortcntatioii. Other important selection factors were the insti- 
tutional interest in the project and willir^ness to paiticipate. 
Once the institutions were identified, each appointed a campus 
coordinator for the project. Those representatives traveled to 
NCHEMS for an orientation and pilot implementation session, 
Farticipatton in this stage signified the institution's commitment 
to the process and, also, familiarized the institutional repre- 
sentatives with the background and rationale for outcomes 
idenfieation and validation, A vital link was established, then, 
between the outside group and the institution, thereby legiti- 
mizir^ the endeavor. 

The campus coordinators organized CASC/NCHEMS 
visits to their cotleges^ converung participants and arrar^ir^ 
schedules for individual appointments. A workshop was held 
at the beginning of the proceedings to familiarize campus 
representatives with the purpose and procedures for the inter- 
action. Essentially, three activities were scheduled for the 
workshopr' 

1, Introduction of CASC and NCHEMS lepiesentaUveS 
and the outcomes project 

2, Orientation of participants to terminologyt definitions, 
and use of materials for outcomes planning at "ic departmental 
level 

3« Participation in role playing about the use of outcomes 
concepts as a basis for allocation of funds at the institution' 
wide level. 

After the role-playing exercise, the CASC representative 
offered observations, and ihe participants were a^ked to com' 
ment on the exercise and materials provided. 

Individuals were interviewed during the next one and 
one-half days by Lenriing of NCHEMS and the CASC repre- 
sentative visiting on campus. Interviews followed a specially 
prepared interview instrument,^ Faculty niembers, students, 
and administrative personnel were asked to comment on insti- 
tL:ional outcomes but, more importantly, to concentrate on 
student- learning outcomes that they desire (or intend/plan to 
bring about) for students in their program areas. 

Priorities that different groups gave to the vanous out- 
come structure, typc^of-outcome dimension categories at each 
college, arc presented in Table h (Because ofthe small numbers 
of respond entSt percentages t:ould not be used,) These data are 
discussed in depth in Lenning (I977e) along with (a) specific 
outcomes suggested as especially important for vanous prtortty 
categoric^f (b) concrete measures and mdicators which can 
provide adequate evidence that ihe outcomes of concern have 
occurred, and (c) thcstudentactivitfcs and experiences that the 
various respondents felt would most contribute to brtn^mg 
about the particular outcomes they had emphasized as being 
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Table 1 

Priority Ratings of Outcome Categories by Three Ga$$es cf Respondents* 
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especially important. Although a nutnbcr of fioic worthy varia- 
tions tn patterns for (JifTcrcnt institutions (an(J groups within 
institutions) are noted in Tabic 1* institutional differcikcs in 
roeui; and activities really seemed to stand out when ihc 
ctnphasis shifted to a more speciftCi concrete IcvcL 

As a result of the workshop and interview activities* ihe 
rdlowing observatiofis tnay he made: 

I > Concept or student learning outeomes is new (andi 10 
a degree* suspect) on college catnpuses. 

2* Role playing the use or outeomes in the resource 
aJlocation process ean Tacilitate inieraciion and communications. 

3* It Is extrctnely difficult for tnost faculty to dceide on 



outeotne priorities and to go frotn detailed outcome categories 
to specific* con^;rete outcomes* but they can do so successfully 
wjih the help of pfx>cedurcs like those delinoaied In this ap- 
proach. 

4. Faculties resist the delimitations of outeotncs meth- 
odology. 

The long-ierm impact of the exercise is dtffieult to 
gauge* although the residual efTeetf as judged by informal 
commicnts* has been positive. For example* many of the facuhy 
members outside of edueatton e^claimed that they had never 
hef ^le tried to think in this way about what the^ were trying 10 
accomplishi and they seemed stimulated. 
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Results or the CASC approach. The CASC approach to 
eampus selection. piepai::aiion of representatives, and orienta. 
tions differed markedly from the N CHE MS, approach. While 
selection crileria for institution participation were similar, 
greater attention was given to minimizing the cost of project 
implementation. Because of limitations of professional sta^ 
and money, task force members prepared explanation materials 
which covered concepts, rationale, and processes of the task 
force. Two brief reactions are appropriate of this point; first, 
too much material was sent to respondents; second, loo little 
material was read by respondents. This latter condition neces^ 
sitaiett a brief orientation session during most interviews. 

Once the campuses expressed agreement to participate, 
expfanatoiy materials were s^/it toeachcampiis representative — 
who then distributed the materials to campus administrators, 
faculty^ and stutlents. CASC representatives (in pairs) inter- 
viewed on eamptis at one-hour intervals, using a special inter- 
view instrument. Some of the responses to the concepts antl 
problems were admittedly negative; whetherthis resulted from 
ignorance of the material or a thoughtful disdain is difficult to 
say. Other responses were veiy positive, as If tiie concepts of 
activities-outcomes linkage provided a means of expressir^ 
educational practices in a more forthright manner. Overall* it 
is tfifficult to say whether the colleges benefited f^om the inter- 
view experience. Sone of the factors which mitigated against 
the implementation were: 

1* The lack of awareness of the institution as to what 
local benefits derive from the exercise and who sanctioned the 
process. 

2. The amount of material sent to each respondent which 
discouraged some antl confused others. 

3. The fact that no context hatl been established for the 
interview, whkh meant that the interviewers hatl to "make 
their case*' to a number of interviewees. 

4. The fact that the mechanism for incorporatitig the 
interview findings inio a planning process were not made clear 
to interviewees. 

Hence, a number of factors diminished the efficacy of the 
CASC approach But, starting with a discussion of activities, 
ralher than otileomes. docs facilitate early interview discussion. 
Faculty members, especially, are more ready to talk about 
activitities than they arc about outcomes. 

Conclusion 

The |>ercewed usefulness of the two approaches. Four 
factors arc perccivetl to be important in judging these ap- 
proaches: 

U Clarity of communications — how well wm key con- 
cepts expressed and understood? 

2. Perception of relevance and interrctaledness— how well 
did respondents incorporate the concept and leiminology into 
institutional possibilities? 

3. Institutional responses— did decision makers atlvance 
the purposes of outcomes identification and validation? 

4. Receptivity and/or resistance — to what degree ditl re- 
spondents contradict or complement the concepts presented in 
the interview or in other fonnats? 

Cleariy, there were both positive and negative aspects to 
each approach suggested by evaluative statements reported in 
the previous section. Some of the problems with each approach 
could probably have been worthed out with improved inter- 
viewee preorientation. extra practice in interviewing tech- 
niques and approach prior to starting the interviews, a* 
careful setting of the stage within the interview, and so forth. 
Even so, however, a combination of (he two approaches may 
be desirable, and would involve (a) carefully planning orienta* 
tio n workshops, (b) starting the interviews with activities and 
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going to broad outcomes, as in (he CASC approach, and (c) 
going to specific outcomes and then back again to activities, as 
in the NCHOMS approach. 

What, then, are the benefits of the concepts, approaches^ 
and instrumentation as developed by the CASC/NCHEMS 
effort? Two seem especially apparent. The first Is bridge 
building in the academic institutional planning cycle. Academic 
planners are confronted with a panoply of expectations and 
severe constraints on resources. Expectations either become 
canonized in the college's mission staienients or they sub* 
merge, awaiting resuschation through the next foundation 
grant. Granting consensus on goals, the planners are then 
confronted with programmatic reinforcement off or deviance 
from, goal attainment. A second benefit, that we as researchers 
have witne^d, is the stimulation of faculty members toward 
consideration of larger- than-classroom issues. At one college, 
a professor of chemistry averred that the issues which transcend 
courses, classes, and departments ?^ at the heart of liberal 
editcation. Faculty members who reacted negatively to the 
concepts of outcomes identification were similarly stimulated 
to look beyond the shibboleths and pat assutrotions that most 
of us shield ourselves with. In a sense, outcomes identification 
brings assumptions about procedures and commitment to pur- 
poses out into the open for discussion* debate, and dialogue. 
Sharing of goals and outcomes among departmental faculty 
n^bers can be the first step toward collegial relations among 
all faculty members. The prospect of community building in 
academic environments can enrich all sectors of higher educa- 
tion, from students seeking guidance and instruction, to pro- 
fessors and administrators seeking a wholeness and unity in 
the academic enterprise. 

The perceived usefulness of the outcomes stnicture. 
The NCHEMS approach was built around the outcomes struct 
ture. and it did give stnicture and an impetus to the interviews. 
However, the code numbers were discrncerting to some, as 
was the psychological jargon to a few others. And it was not 
until thc^interview situation that most interviewees seemed to 
start sensing real potential significance for the stnicture. At the 
end of each interview, if there was time, the interviewees were 
asked to rate the potential usefulness of the outcomes structure, 
based on their limited experience with it at that point. Table 2 
presents tabulations of their replies. These limited data indicate 
that the reactions of most respondents to the stniciure was, by 
this tinie, fairly positive. Some respondents ditl, however, 
menUon cautions and potential problems with the stnicttire. 
They also perceived some specific uses for it. (The list is 
available from the authors.) 

Table 2 

Expressed Opinions of t^sponOents 
Concerning the Usefulness of the Stnicture^ 





Did not DcHnitely May be 
discus uscfbl uscfhl 
it 


Not 
usefb] 


Said ihat ihey 
did not under- 
stand ti enough 
to judge 


College A 
Atlminisuators 
Faculty 
Students 


5)13 
10 13 9 
4 6 1 


3 
0 
1 


2 
0 



^Each number indicates how many people ^n that group (idcntitlcd 
in ihe leti margin) gave a panicular response ^idcntitlcd bfy ihe column 
heading). 

The CASC approach was not built around the stnicture 
but utilized it in the attempt to make the transition from a focus 
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on activities lo a link between acMvitte^ and outcome aieas. In 
this scnsCf it wa^ central to untJerstandrngs of the relationships 
of activities to the loiger purposes toward which those activities 
are directed. Without the outcomes structure categories^ the 
facult> members could have focused on activities wnhout an> 
s>stematic examination of the larger purposes. The outcomes 
structure A^as also noted to serve as a taxonomic device for 
communicatbg outcomes across disciplinary lines. 

The evidence thus suggests that the outcomes structure 



wasfacilitativein the efforts of both approaches. It ispo^ible, 
hoA^ever, that it could have had more of an impaet had it been 
applied in a different v^a>. Furthermore, this is not to suggest 
that the outcomes structure is complete and of the best possible 
form and content. As mentioned m an earlier section, it is 
expected that the structure will continue to develop and be 
improved as it is used in man> different contexts y^\i\^m 
different types of institutions. 



Footnotes 

[bcCASC L^aniJo; OtucoiiKsTask Fbfc« Tor their coflutbution V} ihh pcoiect's $tic^ii. 

'A survey qutitioflitairt torn of thii instrumcot his $ihcc httn devebpcd and U cuncntty being reviewed. 
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MANAGEMENT INFORMATION SYSTEMS AND 
SIMULATION MODE! 5: TO BUY OR NOT TO BUY? 



Charles H. Farmer 
Kashenne Frame 
Richard A. Priest 
Jof\n Ozment 
The University of Tulsa 



A few years ago, the Exxon Education Foundation became 
concerned that institutions in postsecondary education were 
not cognizant of computerized management techniques. With 
Ihis in mindf and with a goal of helping academic adminis* 
Irators leam to nin institutions better, the foundation embai^d 
upon a program to award over $3.5 mUlton in grants to 
approximately 60 private Institutions throughout the United 
Stales. The University of Tulsa (TU) was one oTthe recipients. 
The program, called the Resource Allocation Management Pro- 
gram <RAMP), was to last approximately five years. 

The University of Tulsa has used its RAMP grant to 
develop information systems which will permit managers to 
employ limited resources more effectively. The resource allo- 
cation syslem that has been developed has the potential to 
assist the university in upgcadiiig ils academic planning decision 
making as these impinge on the use of future resources for 
instruction. More speeifically, it is hoped that the simulation 
model will be used as a tool to complement the traditional 
system of cuniculum planning by enabling the university to 
consider direct cost analysis inputs of future situations. The 
faculty and administration will* IhuSt be able to use the new 
system as a sort of testing ground for their idea. 

Data of this sort would be useful if the university's 
administration had to consider an increase or decrease in 
eiuollincnt due to policy decisions made on P^icufar academic 
programs In previous years^ when administrators and faculty at 
the Universi'y of Tulsa pondered the impact of this kind of 
decision, they had to rely on relatively inaccurate estimates. In 
the future academic year, the TU administration need only 
feed the proposed enrollment figures into the simulation model 
and ask what will happen. Not only will the reports show the 
change in tuition revenues the university should expectt but it 
will also simulate the less obvious results of changed enroll- 
ment such as the number of faculty and resources required to 
maintain educational conditions. It is expected thai when Ihe 
system is in use. it will provide accurate data for the budget 
planning process. In that way* it will cause financial documents 
to correspond more completely with academic documents and 
will more completely link the budget to the university's ol^cc- 
tivcs and priorities. 

For many professionals in the academic worldt the debate 
over money is now as central as that over student life and 
course content The quality of that debate will most likely 
depend on the willingness and capacity of faculty to understand 
the bastes of academic economics. Their involvement in the 
institution *s affairs will continue to increase and could lead to 
faculty recommendations for the campus allocation budgets. 
Traditionally, Ihe faculty have been bonjbarded by cmbina- 
tions of objective and opinion survey inethods as well as 
endless commitice work to examine their attitudes on discipline 
development and institutional pnorities. Their recommenda* 
tlons^ however, need to be validated by sober and empirically 



based cost analyses. It i$ anticipated that this resource allocation 
system will provide new capabilities for retrospective cost 
invectlgation and simulation for costing alternative futures. 

Although the resource allocation system provides reports 
aggregating enrollment and financial data tn order to detect 
trends in academic programs and disciplines^ some ancillary 
benefits have been realized. One such benefit ^vas the process 
of defining the lines of authority and responsibility more 
clearly and clanfying specific institutional objectives m or^er 
to automate certain policy decisions associated with the system. 

To recapitulate the purpose of this i^uree allocation 
management system; it is to preserve strong steps already 
taken that have resulted in fundamental improvements m the 
budgeting process and academic management and to insure 
lhat Ihe trend continues. The resource is better information 
which is more closely related lo the academic management 
debate than that which was previously available. 

The development of the University of Tulsa's Academic 
Resource Management System was neccssanly preceded by 
the development of three other systems: student rccor^St budget 
accountings and payroll/personnel. The Mudent records system 
was developed as an integrated data base in {972. Data 
and retrieval are accomplished by terminals in Ihe registrar's 
office and the admissions office. Voluminous reports (e.g. 
class lists) are requested by terminal and printed m the com* 
putcr center at night during the second*shift operation. The 
syslem receives data concerning the prospective student at the 
time of his or her application for admission. The student's data 
then is kept up to date by terminal in the admissions office 
until he or she is enrolled^ at which time the data becomes the 
responsibility of the registrar's office and is updated by terminal 
from that locatiott Data concerning the student remains in the 
data base forone academic year aftergraduation. Reports (e.g. 
grade distributiont course distributiont and eniollment statistics) 
are also available from the student records system and are 
made available to other administrative offices. 

Another feature of this system* already in use. is the 
budget accounting component. This component has recently 
been converted to an integrated data base. The output is a 
budget repon for all cost center administrators. Expenditures 
from the cost centers^ such as supplies* travel, phone^ postage, 
equipmentt staff salaries (not teaching salanes)^ are reflected. 
All pertinent data are input by a terminal in the budget office. 

The final feature of the system at Tulsa University is the 
payroll/personnel component through which all employees are 
paid and data for most governmental reports arc stored. This 
component is nin via terminal in the payroll office. Faculty 
salaries arq entered as academic budget commitments for nine* 
month intervals. The sum of these commitments for a gtven 
cost center is then entered as a transfer into the budget for that 
cost center. 

With these Ihrec components operational as independent 
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ay^tcmst all the necessary data were available for the creation 
of our Resource Management System. AlthoughTlJ had already 
deeided to eomplement the tradittonal system of eurrieulum 
planning with direet eost analysis inputs^ they had not solved 
the dilemma of whether to buy an ofT-the-shelf paekage or to 
design and develop their own Managementlnformation System. 
A decision was made based on an interpretation of the following 
germane faets, (a) aeeurate base data had already been col- 
iected^ (b) eonsiderable in-house eomputing expertise was 
available, (e) the ehiefacademie officer waseommittedto both 
planning and rrtorc sophisticated utilization of modem n.^inage- 
ment techniques. While these facts were being considered an 
apparent golden Easter egg was encountered, a commercial 'V 
available information system in ihc fonn of a do-it-yourself ki 
called CAMPUS <Comprehensive Analytical Methods for 
Planning UnWersity/Colfege Systems), U was felt that this was 
the only rnodel capable of providing the detail and dis^grega- 
tion necessary to simulate the university. It was felt that its 
focus (primanly on long-range planning and program-oriented 
budgeting from one to five years in the future) was appropriate 
for the needs of the university. 

The advantages of stich a package seemed obvious: <a) it 
was available immediately with no development cost; (b) the 
purchase price was low, (c) the comptexity of the simulation 
model reinforced the opinion that it was sophisticated enough 
to accurately model the university, and <d) it produced a 
plethora of reports which purpor^d to give an integrated view 
of university operations allowing users to engage in better 
f lancial and ctirricufum planning. Other reasons for the selec- 
tion of the CAMPUS model were that it was already operational 
in several other institutions^ there was extensive documentation 
for the computer software, and there existed an experienced 
installation team available for consulting on a per diem basis. 

After successfully implementing the CAMPUS system, it 
began to be recognized ntore and rrtore that the appltcation of 
better infonnation to the improvement of academic manage- 
ment is a process where unr^rtainties cxistt since the use of 
information is inevitably tied to the level of desire to use it in 
the making of policy decisions. The original assumption that 
the application of new computer systems and output data from 
them should be linked as closely as possible to the practical 
affairs of the university had to be faced as well. In view of the 
desire to achieve iJistinct results from the creation of Informa- 
tion systems, primary emphasis was placed on two things, (a) 
the application of tested computer software systems to the 
procedures of resource allocation management and <b) the 
adaptation or creation of these systems to specific resource 
managcrnent decision areas in the University of Tulsa, 

To describe the objectives in another way, a system was 
destrcd that rciated more simply in the beginning and more 
specifically m the final analysis to the practical planning 
problems of the university, 

CAMPUS IX 

Optimistic that it was the best way to achieve these 
objectives^ CAMPUS IX^ consisting of several volumes of 
documentation and a computer tape^ was purchased. After 
Only a few weeks of effortt the system was installed. Almost 
concurrently^ the data from the test-case university were sue 
cessfully run^ Tlic next step was to gather data ffom the three 
base systems of TU in a foim acceptable to CAMPUS IX, The 
problems encountered were nunfierous, {a) the documentation 
provided was not completely consistent with the program 
opc[attonf<b) system limiUf such as number of course offt;ringSt 
were not always adequate to handle the application^ <c) in 
CAMPUS IX, all courses ha4 to be assigned credit hours 
w hieh was not the case at TU, <d) for a three hour Iccturc/lab 



course, CAMPUS IX assigned two hours of credit to the 
lecture and one hour of credit for the lab, whereas at Tulsa all 
three hours were assigned to the lecture and no hours to the 
lab,(e) CAMPUS IX provided fbronl> three financial program 
classifications whereas r^iie were needed* (0 CAMPUS IX 
required that an academic cost unit and an academic discipline 
be one and the same> but at TU an academic cost unit was able 
to support multiple academic disciplines and an academic 
discipline could be supported by multiple cost units* (g) there 
was great diffjculty working with the conversion tables that 
were provided to convert university codes to the codes accept 
able to CAMPUS IX. However, it was even more difficult for 
the users of the output to translate the data back into familiar 
tenns. In fact, so much time was spent in iranslation that the 
promised utility of the system was negated b> the lack of 
interest on the part of the users. 

It became very clear that if such a system was to be useful 
at the University of Tulsa, it would have to be easily under- 
stood by the user and* at the same time* accurately represent 
the way the university actually functions. To accomplish that 
with CAMPUS IX meant extensive modification and rewrite, 
CAMPUS IX was therefore abandoned after six months of 
effort, 

A decision was then made to develop a new model for use 
at Tulsa for the following reasons: 

1 , It wou\d allow for the accomplishment of the previously 
mentioned tasks and afford the opportunity to take advantage 
of the state-of-the-art tools connected with integrated data 
bases, 

2, The system could be an extension of existing base 
systems, 

3, The problem could be approached in a modular fashion, 
that iSf the system need not be any more complex than necessary. 

4, It could be easily rnodified because the designers 
would be on site, 

5, The model could be influenced in the design process 
by the line adniinistrators who would gain the most from 
utilization of the product. 

Having made the decision to go to an in- house design and 
development of the Resource Allocation System, several ob- 
jectives were held in mind. One objective was to provide 
reports giving categories of costs covered by rrtonics budgeted 
to academic cost centers (i-e, cost centers related to student 
enrollment such as the Division of Mathematical Sciencest not 
support centers such as Computer Services,) Another objective 
was to provide reports giving profiles of faculty activity (i.e. 
percentages of time spent in various work areas such a instrue^ 
tion, researehf committee work* etc,) as well as profiles of 
teaching loads at various course levels (freshman through 
Ph,D,), Moreover, it seemed desirable to develop on-line 
programs to provide a means of examining the financial con- 
sequences of eliminating an academic program^ For example^ 
what would happen to enrollment in art courses <and, therefore, 
to the eost per credit hour of tcacNng art) if art education 
should be eliminated as a major program? 

Although the Academic Costing System <ACS) cannot 
show administrators what decisions to makct it can provide 
them with a means of detecting trends in cost based upon 
historical data. Moreover, the ACS pennits university manage 
ment an overall view of a compk^x situation. 

The ACS is fed with data produced by ^he three original 
systems, student records data base (enrollment data), budget ac 
counting (acadcnuc cos; center budget data), and payrolf/personncl 
(salary data) which is supplenfiented by faculty activity analysis. 
Like the Student Records System, the ACS uses integrated 
data base techniques which allow easy access to data and great 
flexibility in the way that data can be presented in reports or on 
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a terminal screen FufthcfmorCf the system incoiponites the 
general concept of the academic cost matrix* enabling costs 
to be discussed by discipline^ by major program, by major 
within discipline or vice versa. At TU, it was^ found that the 
academic matrix commonly reTerred to as the induced course 
load matrix (ICLM)^ is an important concept in Our model and 
a useful tool for estimating impacts of disaggregate student 
demand* 

As previously mentioned ^i 1^ discussion of problems 
encountered with CAMPUS IX, the academic cost centers at 
the University of Tulsa do not correspond to the vanous 
disciplines on a one-to-one basis. The division of Mathematical 
Sciences, for example, supports not only the discipline of 
mathematics but those of computer science and statistics as 
well* Bach cost center administrator must* therefore, fill out a 
worksheet to indicate budget allocations to the vanous disci- 
plines. To illustrate, the chaiiperson of the Division of Mathe- 
matical Sciences might allocate 80^ of his or her supplies and 
expenses budget to mathematics, ]5% of the same budget to 
comp^r science and the final 3% to statistics. In a like 
manner, the administration would provide allocation figures in 
other areas such as staff salaries (not including faculty salaries 
which arc allocated from faculty activity survey data). The 
ACS ^se is designed in such a way that the pereents 
provided by the cost center administrators may be readily 
translated into costs assignable to the vanous disciplines. 

After the ACS has been loaded with data for a particular 
academic term* it may be used to provide administrators with 
two reports, one dealing with costs associated with the vanous 
disciplines and the other with costs associated with ihc several 
majors or degree programs offered t>y the university. The Cost 
of Discipline report (COD) provides term -specific enrollment 
and Credit-hour and cost figures for each academic discipline at 
each course level. Included are both direct instmctional costs 
and overhead as well as cost per credit hotir and cost per 
enrollment figures. All of the above categories are summarized 
at the division and college levels and for the entire university. 

The Cost of Major report (COM) uses essentially the 
same format as the COD report, Figures are given for each 
major at each course Jevel andaiesummajiEed for each coWcgt 
and for the university as a whole. 

In addition to on-line versions of COD and COM, ACS 
contains a program to simulate the EJtmination (EUM) of a 
designated major from the list of TO degree programs. The 
ELIM procedure may be used )i conjunction with COD to 
project the effect on a given discipline when a major is removed. 
To ilJustrate* before the elimination of a specific major at the 
university, a prediction could be made determining the cost per 
credit hour increase or decrease for the disciplines associated 
with that major. 

The on-'line COM and COD programs provide Output 
similar to that of their batch report counterparts* but cost and 
enrollment figures aie shown Only for those majors or disctplirbcs 
selected at the terminal In addition* the on-line versions of 
COM afford the option of displaying discipline-within-major 
information, while COD allows major-within-discipline figures^ 
if dccircd. 

Accuracy of the ACS depends on th^ accuracy of the 
facuItW activity data. The University of Tulsa has been col- 
tecti^g data on faculty activity since fall 1 975.^ Faculty activity 
analyse are one of the more important information acquisition 
tools^avanablt for three important reasons: 

1 Faculty, who are ihesubjcct of the analyses, represent 
a significantly large portion of institutional operating dollars 
expended each year« 

2 The ways in which other monies are expended (e,g, 
supplies and expenses, duplicating, travel* etc), as well as the 



amounts of these monies^ depend in large measure on how 
faculty dollars arc allocated, 

3, E)ecisions concerning faculty obviously have direct 
humanistic considerations, whereas the use of other resources 
such as spacer equipnfient^ and tinfie involves indirect humanistic 
consequences. For example* it would be ludicrous to arbitranly 
optimize the use of space white treating faculty displacements 
as a secondary by-product. 

The data collected from the Faculty Activity Survey form 
a Faculty Rle. This is then input into the Faculty Activity 
System which produces two reports: (a) Teaching Profile (total 
and average number of students by course level and academic 
rank), and (b) Staffing Profile (average peiceniage of time 
expended by faculty— partitioned by academic rank within 
discipline> within college). 

Academic Costing Systems 

Ttte problems faced with the design of academic costing 
systems have been canonically characiertzed by Weathersby*s 
(1973) aphorism: "costs are opinions, prices are facts!" The 
point is that estimating costs with no consideration of prices 
attached to either the activities or the outcomes of an academic 
unit must be avoided. We must* however, continue to remem' 
ber Enthoven's (1970) law which states: **It is better to be 
roughly right than exactly wrong!" 

Although the attempts to apply unit cost analysis to higher 
education date back to the late IBOQs, there has been little 
advancement and correspondingly little value to improved insti- 
tutionaJ management achieved from these attempts. The pro- 
blem is that effective use of unit cost data to support policy 
dectsions can only be achieved if there is a grasp of the implica- 
tions, limitations, and the relationships of the numbers that 
supposedly describe our program costs. 

We know that cost data in higher education are produced 
by etther cost accounting or cost analysis. In cost accounting* 
financial transactions^ entered in sucha way that expenditures 
are attributable to the ultimate cost object. Cost analysis* on 
the other hand, places cost to selected cost objects by means of 
analytic formulations usually pertaining lo specific manage- 
ment problems. 

The cost-accounting approach (Topping, I ^4) ts used t>y 
the National Center for Higher Education Man^ement Systems 
(NCHEMS) at the Western Interstate Commission for Higher 
Education (WICHE), They have developed a standard set of 
principles and procedures to facilitate imerinstitutional data 
exchange and to improve external agency reporting. 

Although it is difficult not to attribv j more precision to 
subjective data than actually exists, the cost analysis approach 
is generally more useful for input to institutional policy deci- 
sions tlian cost accounting. Farmer (1^73) gives four stages in 
analyzing costs: (a) a listing of the resotirees required for 
some puipose, (b) an identification and description of altema- 
ttve resource uses, (c) an estimation of the values of the 
alternatives as they relate to goals* and (d) an estimate of 
incurred expenditures. 

In addition to the four stages of analyzing costs, the 
following statements by Plotjrde(l976) have been found to be 
very useful: 

1 , The process of using a model is as important as the 
model , The discipline required for data gathering in a uniform 
fashion for input to the model and the attendant discussion on 
use of data output is the most viable aspect of model use. 

2, Model builders mustbeawateofand responsive to the 
desire of niodel users for simplified input and output, 

3, Users must develop data bases to support day-to-day 
decision-making processes as ^vell as the long-ra^ge planning 
process, 
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4. All adminislmtors should participate in tndning sessions 
keyed to user education. It is one thing to train individuals to 
build ai^a keep models running, but h is quite another to 
develop constructive attitudes toward the usefulness of the 
model. 

5. Unless there is an organizational contmitment from a 
high level to integrate the use of the model tnto the planning or 
decision-making processes, the model itself will remain a toy 
for inslltutional researchers, computer center personnel, and 
other slaff, and few significantbenefits will be denved from its 
use. After all* what does it accomplish to have a perfect 
computer implementation of a modeling system if, in the end, 
it is not understood! not supported^ or not used? 

It is hoped that the ptcsem system will become an eHective 
tool for managing the academic cost of inslruction at the 
University ofTulsa, Chairpersons can, for the first time, get an 
overview of how their academic cost units are performing. 
Deans can obtain more information on how their colleges are 



performing and can further evaluate the ramificu'ions of elimi- 
nating or adding degree programs. This data, collected over 
time, can be used to identify trends. To reverse a trend (e.g, 
lower or raise the cost of instruction)* administrators will be 
told by what percent their budgets must be changed in order to 
achieve a desired cost level. They then will have to decide 
where* within their own budgets, change can be effected. 

Future plans for the system will allow a dean to simulate a 
new degree program and obse^rve the effects on all phases of 
academic costs. The system also can be used for budget 
projections by using histoncal data to predict future needs. 
Additionally! future desires can be articulated and the implica- 
tions on the total cost of instruction evaluated. 

The point to be made is that only the first basic steps have 
been taken, and future success will depend not only upon the 
quality of the technical product but also upon the ability of a 
product to bnng about positive change in the university. 



Footnotes 

'ThelCtM (xm^ivcd, dev«topcd, and pui (oosc by Sidnc) Suslow, Director of Instttmicuial lt«5«arch at ihc Univcnji) of Cbl^fofnu, Bcrl^cTc), m 1951^ The 
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sometime^ inapptof rtaielyj In simulation models for sivdics of cosis, personnel, and space need$, 
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HTgher education is in the middle of a decade of change. 
Colleges and tiniversities are faced with enrollments that ate 
leveling or declining, as wcti as with financial pn^sstir^ and a 
cnsU of public confidence. These troubles, dim|y foreseen 
duiing the prosperous days of the 1960s, arc now recognized 
as threatening by most leading educators. The purpose of this 
paper is to propose a framework (or evaluating and developing 
One of the key processes by which higher educauon can meet 
the challenge ofthecomingdecade> (hat is, institutional planning. 

Since the first appearance of the cunent pressures on 
higher education* colleges and universities have been advised, 
coerced, and otherwise influenced to apply a variety of method- 
ologies, techniques, and tools to the solution of the problems 
besening higher education. Help and gmdance have been sought 
from nianagement science* operations leseaich* the systems ap- 
proach^ planning* prpgramming, and budgeting systems (PPBS)^ ' 
and management information systems (MIS)* to mention a 
few* These methodologies^ techniques, and tools have been 
applied in many institutions with only modest success. 

Institutional planning — the root pioccss underlying the 
above-mentioned applications — needs to be re-emphasized. 
To achieve its f^l potential, institutjonal planning must be 
developed into something more than a collection of techniques 
and methodologies. It must be developed into a approach to 
institutional decision making. Although there are probably as 
many definitions of planning as there are people who call 
themselves planrters* for present purposes, institutional plamiing 
IS defined as a cyclical piDcess involving (a) a detennination of 
where the institution is* (b) an assessment of where the institu- 
tion wants to go, (c) a decision(s) about how it is going to get 
^there^ (d) the implementation of lhat decision(s), and <e) the 
evaluation and* if necessary* modification of that decision(s). 
(See Jaquilh 1976.) 

The planning literature reveals a number of m^or prob- 
lems in the area of institutional planning. Hrst* while many 
institutions sra engaged in planning activities of one sort or 
another, planning is still veiy much of a developing art. 
Second* many institutions devote m^r resources to planning 
Only after they are in trouble. Third* all too often, institutional 
planning culminaies with the production of a static ""institu- 
tional plan'' that does nothing but collect dust on the shelf. 
Fourth, there has been litde systematfzation of the admittedly 
modest knowledge on institutional planning into a fonn that 
might be useful to practitioners in the process of developing or 
improving their planning efforts. 

Although tl^ first thiee problems will receive some atten- 
tion in this paper, the primary focus is on the need to synthesize 
what we have learned thus far f>om the theoiy aiKt practice of 
higher education planning. The intent of the papei is not to 
suggest a model fbr institutional planning. Indeed^ despite the 
evolving nature of higher education planning, it is already 
evident that there is no single approach to planniiig tfiattwill 
suit the needs of eveiy institution. Rather^^4he^ntcnt is to' 
distill, from a growing field of expcrieiio£vN^asonably con- 
cise statement of what we have leam'*d ana^to suggest an 




approach to applying thi$ knowledge to the improvement of 
institutional planning. 

The paper is divided into three major sections. The first 
section examines the conceptual literature and the experience 
of a variety of institutions with respect to five major planning 
issues: (a) the scope of planning* (b) the structure of planning* 
(c) pa^ieipation in the planning process, (d) planning and 
budgeting, and (e) planning as a process. This analysis draws 
upon the conceptual literature on higher education planning, 
two major empirical studies of institutional planning (Freeman 
1977 and Palola & Padgett 1971) and a variety of institutional 
planning documents from four major American universities 
(American University^ the University of Pittsburgh, the Uni- 
versity of Washington^ and West Virginia University). Based 
On the experience with respect to each of Ihe five major 
planning issues* Ihe second section of the paper suggests a set 
of desirable planning process characteristics. Finally* Ihe third 
section proposes an approach to evaluating an institution's 
planning efforts, utilizing the set of desired planning process 
characteristics as a framework ht evaluation. 



Five M^or Phimlng Issues 

The scope of plannlitg. The first planning issue selected 
for anal^^is is Ihe sccpe of planning. Nowhere in Ihe literature 
is the variability of institutional planning activity more visible. 
Three sources of variability stand out: (a) Ihe time frame (ot 
-nstitutlonal planning, (b) the comprehensiveness of planning, 
and <c^ the variable emphasis on means vs. ends. 

With respect to time frames* long-range planning is gcn^ 
erally viewed as planning for five or mote years ahead. The 
modal time period for institutional planning reported in the 
Freeman survey is five to six years. Only two of Freeman's 23 
respondents reported time frames of more 10 years. Some 
institutions utilize multiple planning periods within the total 
span of their planning documents. Another approach is the 
annual planning update employed in the PPBS model: each 
year, at least tn theoiy, another year is added to the plan, and 
the first year of the plan is converted into resource allocation 
decisions. 

The comprehensiveness ofthe planning process is another 
variable by which one may differentiate among planning pro- 
cesses. Freeman defines comprehensive planning as ''any fon^u* 
system for integrating long-range academic, administrative* 
financial) and facilities planning for the total university and i^ 
principle components'' (p. 26). In addition to functional or 
horizontal Integration, comprehensive planning also imolies 
vertical integration^ lhat Is, integration of planning from depart- 
mental through ci^tlege to institutional plans. Contrasted to 
comprehensive planning would be planning processes of more 
limited scope — for example, facilities planning or departmental 
planning. The responses to the Freeman survey suggest that 
relatively few institutions have achie|vcd the level of Integra* 
tion suggested by Freeman's definition of comprehensive 
planning. Beeman also found that the comprehensiveness of 
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planning varies by oiganizational leveU with academic depait- 
ments eng^ing in the least comprehensive planning (p. 40). 

The final scope issue examined heie is ends- or goal- 
onented vs. means-oriented planning* This dichotomy has 
been referred to in scveml different ways. Robably the most 
common is strategic vs. tactical plannii^ Fincher (1972) 
refers to effectiveness vs. efinciency-ori''ntc4 planning (p. 
754). Palola and Padgett use the terms subst^mtivc vs. ex- 
pedient planmng <p. 27). Ackoff <I974) speaks of proactive 
vs. reactive plannii^* The fundamental distinction involved is 
whether the planning process is concerned primarily with 
deflnmg and pursuing institutional gpals or whether it is pri- 
manly concerned with enabling the institution to respond to 
environmental forces* Palola and P^idgett found that goal- 
onented planning occurs at relatively few institutions- -priniarily, 
small, homogeneous, pnv ate colleges. 

Stniftiiral considerate ns. Another source of variability 
among institutional planning processes the structure of plan ~ 
ning. Three issues stand out. <a) whether or cot the planning 
process should bt formally structured *(b) whether it should be 
centrahzed or decentralized* and ^c) whether it is desirable to 
employ the existing governance structure or a ntv^ stnicture to 
perform the planning function. 

Planning can be either formal (structured) or iriformal 
(un&tnictured). Infonnal or unstructured planning does not 
Imply that planning is not to be pursued but^ rather, that it is 
expected that planning will xcur as various offt' v - carry out 
their respective '^_«<ctio:^. Fcnnal or structured plaa^mg impGes 
that an organization systematically allocates time and resources 
to thinking about* prepaiing for* and attempting to influecce 
the future. Unfortunately, there is very little information avail- 
able about informal planning. However* one point does stand 
out in hterature. if an organization does not deliberaiely devote 
some resources to planning, it^ decision makers will tend to 
devote most or all of their time to coping with day-to^ay 
problems (Cycn 1975; Haas 1976). 

Another important structural issue U whethct planning 
should be centralized or decentraJized. The "centnst" argues 
that only the central at^ioistration has the necessary institution- 
wide perspective and seTisitivity to the environment to make 
decisions about the basic directions of the institution (Cycn). 
The "'decentnst" argues that the expertise required to make 
decisions and the ability to carry them out resides with the 
operational or line unit (Brown 197:^^ I1)e institutional plan- 
ning documents examined by ihe n'esent authors suggest that 
institutional planning k frcqu .tf> "top-do^^n-bottom up** 
process. That is* it h.'^ ; central formulation of 

institutional missions ana J ^ xreedsf^ program planning 
at the unit Icvclrand it cul . yith the ii^.iegration of unir- 
level ptans into an institutioi.at mister p^ari. This multf-ticrCii 
approach to planning is vtonhy of funha exploration and 
development. (Sec Ackoff* Hociiack 1976* and NefT 1971.) 

The third basic issue concerning the structui^e of planning 
ts whether it is desirable to employ the existing governance 
structure ur a new structure to p^rfonn the planning function. 
The advantage of using existing sfructures is that planning will 
be done by those persons and units n'^ponsible for implementing 
decisions. However* Palola. Lehmann, and Blisehke (1971) 
found that when planning is assigned to existing committees or 
structures, it tends to be given a low priority. Programs of 
c!iangc need active supporters for tlt^ir implementation. One 
of the ways this may be acccmpli5he<l is to establish a separate 
committee structure for planning (Palola and Padgetts p. 80). 
The committee or commission approach to in^:itutional planning 
IS discussed further in the following paragraphs. 



Participation in plann^ilg* Closely related to the issue of 
structure is the issue of participation in planning The literature 
suggests that one of the keys to successful planning — that is* 
planning that produces operational results — is participation by 
at least four major constituencies: the instimtion's chief execu- 
tive* its line administrators* its faculty* and a full- or part-time 
planning staff. 

The need for strong support from the chief executive is 
emphasized by both theorists and practitioners. (See Stciner 
1976.) Chief executive involvement in the planning process on 
a day-to-day basis is relatively rare (Freeman), palola and 
Padgett found that the most important functions of the chief 
executive officer are to foster institutional planning, to delegate 
authority effectively* to openchamiels of communicatien» and 
to confront the task of defining institutional goals (p. 63) 

Insofar as planning is a decision-making process, it would 
seem fairly important to involve those who have major respon- 
sibility for implementing decisions — the institution's line ad- 
ministrators. In this regards it is noteworthy that among the 
universities surveyed by Freeman, only 30 percent reported 
participaiion by acaden c deans in their central planning bodies 
The evidence suggests that at many institutions academic 
administrator involvement in planning occurs primarily at the 
college, school, or department level. 

Faculty participation in planning would also seem mandatory 
(a) because faculty perfonn the line ''unctions of the organiza- 
tion and (b) because* in many cases* they can contribute 
important substantive and technical expertise. However* in the 
majority of the 80 institutions rnrveyed by palola et al * 
faculty participation in institutional planning was characterized 
as light. At the maiority of universities surveyed by Freeman, 
faculty participa'' n planning occurs primarily at the school 
or departntentat xl Palola et aL found that faculty of^cn 
refrain from participating in institutional planning by choice — 
largely because of the lack of rewards for this type of activity 
They found faculty participation most often at state and junior 
colleges where the rewards are greatest for institutkinal service. 

The staff role can be played by a variety of participants* 
depending on the resources of the institution. Typically* this 
role is played by a specially organized planning staff* by 
faculty on release time* and/or by graduate students Although 
the planning staff can play an important si-pportive role* the 
purpose of the staff ts not to plan but to facilitate the planning 
process (Brown; Knoepfel 1973; Schafflr 1976). Among the 
institutions examined for the present paper* the pnmary roles 
of planning staffs include coordinating the planning process, 
developing planning procedures and guidelines, cor^piling 
plans and planning documents* supponicg data* and serving as 
an organizational advocate for planning. 

Planning and budgeting. Although planning and budget- 
ing are often treated sep»ratety in the literature, ihe trend is 
toward greater emphasis ^n the need for a lirikage between the 
two. On the one hand* 1^: planning process must include an 
awareness of resource constraints (Casasco 1970). Equally 
iiT^portant* planning decisions must be convened into resource 
allocation decisions if planning is to have any effect, palola 
and Padgett have suggested th.^t in the absence of a planning- 
rcsource allocation linkage, '"planning in higher education 
becomes an exercise in futility and master plans become little 
more than 'paper tigers' " (p. 81). 

. Jn almost ail of the institutions examined for this paper, 
there Js an emphasis on the importance of planning-budget 
linkage. .. Nineteen of the institutions in the Freeman sample 
cite the need for a better system for allocating resources as a 
major reason for instituting comprehensive planning Indeed, 
Freeman observes that "^resource management considerations 
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(Jommate comprehensive planning at the institutions surveyed, 
even in schools that aie not currently feeing specific financial 
or enrollment problems'' (p. 28), However, none or the sources 
employed by the present authors provided detailed information 
about sueeessful budget linkage niethodologics. The impression 
conveyed is that techniques such as PPBS and formula budget- 
ing have been employed with only limited sucee<;s, (See 
Newton 1976.) 

Planning as a Process, The primaiy focus of this paper is 
on planning as a process* not On the prodicts of planning. 
However, planning as a process can be cither finite or con- 
tinuous in nature. In the first case, the o^jective of the plannijig 
process is typieaJly an institutionaJ plan, Jn second, ;)lannirig 
is a contiiuous cycle from the definition of goals to implementa- 
tion to feedback (Eberic & McCutchcon, 1970), The literature 
On higher education planning appears to favor the latter (con- 
tinuous) approach because the environment is unstable, Inditu- 
tions of higher education must remain adaptive to change 
rather than committirig themselves to a firm, long-term direction 
(Knoepfel; Neff), 

Some planners suggest that the most important outcomes 
of the planning process are process outcomes — e,g,, periodic 
self-e valuation, participation, and communication (Ackoff, 
Meeth 1967). The critics of this position argue that planning 
may be nothing more than an intellectual exercise unless and 
until it results in some operational outcome (Fuller 1976; 
Palola & Padgett), In fact* most of the institutions examined 
for this paper require formal, written planning documents at 
one or more levels of the planning process. The mess^e that 
can be gleaned from the experience at these institutions is not 
that there is anything inherendy wrong with an institutional 
plan but that a plan must be part of a continuous and cyclical 
process. 

Desirable Planning Process Characteristics 

As previously suggested^ it is pr6bably impossiUe to 
devise a universally applicable model for college and university 
planning. The variability of institutional characteristics and 
needs is too great. Moreover, the previous section suggests 
that there is a lack of consensus on some of the basic issues in 
institutional planning, Nevertheless, a re iewof the five issues 
discussed indicates that, on the basts of the experience thus 
far» there may be some basic planning process characteristics 
that are worth striving for. 

First, with regard to the scope of plannir^^ there appears 
to be a time limit beyoi -vhich most institutions ar£^ reluctant 
to plan. That limit is approximately ten years. Increasing 
empha^iis is being placed on the need to integrate academic^ 
fiscalt and physical plant planning. It appears desirable to 
define and pursue institutional goals, but it is also necessary to 
monitor and remain responsive to the environment. 

Seconds with regard to the stnicture of plannir^, an 
instil jtion needs to devote some time and resources to planning. 
Otherwise^ it is likely that plannii^ will take second place to 
the day-to-day operation of the irstitution. The resolution of 
the centris. ^eccntrist debate may rest with the development of 
multi^ticred planning structures in which institutional goals aru 
articubted at the central level, the programming function is 
performed at the college and/or dcpaitmcntal fevcl, and there 
is a central coordinating mechanism to insure a link^e between 
means and ends, ^Planning is likely to receive second priority tf 
it ts defegdted to an existing structure thatbas other (especially 
opcrationa I) respo nsi bi I iti es. 

Third, with regard to participation, it is essential that the 
institution's chief executive oHiccr provide strong support for 
planning, though be or sbc need not necessarily be involved in 



the uay-tO'day planning process. For a variety of reasons, 
academic administrators and faculty have not geneially played 
key roles in institution- level planning. However, if planning is 
to be an effective decision- making process, it would appear 
that greater emphasis must be placed on participation by those 
who have the lespon^bility and expedise to implement decisions, 
A planning ^^ff can play a critical role as organizational 
advocate and facilitator of institutional planning. However, 
the planning office should confine itself to a supportive role. 

Fourth, with regard to planning-budgct linkages, continued 
emphasis must be placed on the development of effective 
budget linkage methodologies. 

Fifth, planning as a process does have some inherent 
values — for example, the values of periodic self-evaluation, 
participation, and communication. However, planning may be 
nothing more than an intellectual exercise unless it results in 
some operational outcome. The planning process* as well as its 
products, must be continuous and cyclical in nature if the 
institution is to remain adaptive to a changing environment. 

Evaluating InstttutConal Planning 

The applicability of the above characteristics to any given 
institution will vary somewhat with the nature of th^ institution 
and the status of its planning process(cs). Assume^ for the 
moment* that an institution has engaged in a variety of pla'ming 
activities over the years—a scenario that is probably <^uite 
common. One of the things that any institution should do with 
respect to all of its activities is to conduct a periodic e'/aluation 
or review of those acti vities. The puq)ose of ttie present and 
concluding section of this paper is to propose an approach to 
evaluating institutional planning, utilizing the set of desirable 
planning chaiaeteristics outlined in the previous section as a 
framework for evaluation. The discussion takes the fonn of 
three general recommendations conceming the manner in which 
a planning pitKcss evaluation might pn?cee<L 

First, the evaluation should be conducted by a committee 
appointed by the institution's chief executive officer. The 
commit' should receive a charge direcdy from the chief 
executive (a) to review the institution's existing planning pro- 
cesses, (b) to consider what types of planning processes would 
best meet the needs of the institution^ and <c) ^ make recom- 
niendations> as necessary^ to close the gaps t>etween present 
and desired planning practices. 

Second, the committee shotild comprise representatives 
from at least three m^r constituencies: central administrators, 
college or departmental administrators (depending on the size 
and nature of the institution), and faculty. Ideally, the group 
should be a small one, composed of individuals who are 
wilting and able to devote sonte time to the effod, if a small 
group is not politically feasible, there should be a small steering 
committee within the larger committee to oversee the com- 
mittee's research and document drafting. In either case, strong 
staff stippon should t>e made available to the committee so that 
the committee's deliberations can be based on careful and 
comprehensive data collection and analysis. 

Thirds the committee should include in its deljt>e''ut[ons 
some or all of the following elements: (a) the institution's 
existing planning processi:s (at all organizational levels), <b) 
the desirable cbaiacteristics of an institutional plannttg process 
(to which tbe present paper is addressed), (c) the constraints 
(cxtcmat and internal) which influence the direction of the 
university, (d) the deficiencies tn existing planning proccsseSf 
and (c) recommendations conceming alternative planning pro- 
cesses or planning process characteristics. 

The potential risk of this approach is that It may favor 
the status quo. That is, it may result in an emphasis on the 
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adequacy of existing planni[^ processes* The extent to whidi 
this occurs wilt depend, in large part, upon the membership of 
the committee. The potential advantages of the suggested 
approach appear to outweigh the risks. First, it eiKourages the 
committee to buUd upon past efforts ratliet than to start from 
seratch. Second^ it enabled the committee to identify and tap 
the plannir^ expertise that already exists on campus. Third, 
this approach is to generate campus-wide interest and 



involvement ^'n ihe tvaiUation eflbrt Fourtli, it makes no 
assumptions abotit the value iit lack thereoD of the institution's 
existing planning processes. Finally^ the recommentled ap- 
proach includes an effort to <fraw upon the experience of other 
in^itutions. Despite the limimtloiis of bighet education planning 
efforts to d^t^t it is apparent that most colleges and universities 
have a long way to go befone ihcy exhaust the values inherent 
in stjdyln^ the experiences of other institutions. 
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OrgHtiiTatiotial Aoalj'sis — k New ApproocH to Pi^nnlnf 

Hie traditional ai^roach to Loiig-r?jige phmning \i* to 
establish an htstitution's nti^ston and goah and iheit io devise 
programs to su^hkve these goals. This approach worked weU in 
a growth period. Now the process may represent time tost if 
goals are selected for which there is Tittle p<^ibiJity of achieve- 
ment. Today's goals^ and changes in program liirsctioni must 
be selected with tite knowledge that we musj work with whar u'e 
have and recognise our potential maneuverabslity in terms of 
available facilities, resources, and n^anpower. {ncremental 
changes :n new directions arc possible. We must* therefore^ 
continue to seek our ftiture course. However^ major s^iiftSf 
previously accomplished usUig growth fundst are no iougcr 
feasible. Organizational analysis is a systematic approach to 
identifying potential change. 

\n most insiitutionSt a different app^ch to planning will 
not r^uiTt abandoning one activity in faVor of another. There 
one econOtiiies of operation to be realized witl^iin c\%ry instimtion 
once we aceept the premise that sustained vitality must be 
developed from within. In Jnany tnstituifons, v/e have developed 
the stnicture to sustain a much larger operation than we have 
achieved, or will aehievc in the foreseeable fijture. It is now 
possible to review that growth and to evaluate it using today's 
realities. 

College and university plaitning. on a continuing basis, fs 
still not an established activity on most campuses. It fs time 
consuming, and a satisfactory link between planners and doers 
has not been developed. Long-range plans have accumulated as 
unique historical evenls. Asa consequence, theplanning that is 
done in colleges and universities is huixied and occurs pnmanly 
at budget time when yes or no decisions must be made regarding 
specific proposals and line item amounts. Oi^izalional analysis 
£ecks \<> provide a worlcablc approach to identify incremental 
changes which would allow the rc-ordcring of priorities by 
identifying and selecting insiimtion-wide trade-ofTs. Organiza- 
tional analysis accepts the premise thatt with rcsUicicd new 
resources^ litde change can be effected unless the sc<^ of 
one activity is decreased in favor of another. However unpleasant 

act may be^ it is necessary if the potential for renewal is 
created in order to sustain institutional vt?^ -I'ty during this 
no-growth period — a period that has alreao axived at nfiost 
institutions. 

Iticrcm»itat Budgeting Is Status Quo IVfaruiiremetit 

During the past ten years^ the consumer p^-^ index has 
risen IS percent. Tlie costs of college and university services 
may have risen at an even higher rate. During tbissame period, 
most Institutions have reverted to incremental budget formulas 
—3 to 1% raises for faculty and staff p 4% for supplies, perhaps 
no change, or a decrease, in capital equipment. Utilities must 
often be budgeted at whatever level is required to prevent their 
being disconnected. The consequence has been a gradual, 
across-the-boanl» retrenchment in most activities. This Itas been 
in addition to any major cutbacks resulting from specific policy 
decisions. Inereme;ttal retrenchment suggests that no reassess- 
ment of mission and goals is taking place, i.e.* nopositive needs 
have been identified that requite positive actions (including cut- 



backs ii necessary) to support new directions. Our purpose has 
become to continue to do what wc did yesterday, albeit at a 
continually decreasing level of support. ^ 

\\ IS possible that this has become the new selected goal — 
that the forces leststing change, who feel that they arc winners 
witli the status quo, are sufficicDtty powerful so that there is an 
cva.V.'^n of tlie tensions that will develop when reallocation of 
resod'.^es talzes place. This may be happening despite the 
inevitable consequence — a k>ss of enthusiasm, comnutm!?nt^ 
and frefimess that occurs with growih and is essential to 
education. It would seem that this enthusiasm should be the 
Inalienable right of the eighteen-year-olds whc are arriving on 
l!ie scene for the first time. It's not their fault that they are 
arriving at the endof the golden era of higher education. It is not 
their fault that we undertook a number of activities that we can 
no longer afford to continue. Thsy can expect that wc will seek 
to sustain the viabilhy which appears to have beeu the natural 
by-product of growth and expansion but which now must be 
sustained in a no-growtltcnvironmcnt. 

WheQ An Era Ends, A New Era Begins 

The era of no-growth is here. We talked about it for five 
years, and now we have actually experienced our first national 
decline in college and university enrollment. Even if an institu- 
tion maintains its enrollmentp inflation and the steep increase in 
costs of heating and cooling will force re-allocation of resources. 
Wc have to learn to redirect our institutional energies towards 
new goals without signi^cant new monies and perhaps with 
substantial decreases. For tl|e first time in the history of higher 
education in the United States, we must grow accustomed to a 
long-term declinep not just some of the constrictions of short- 
term economic recession. 

Some of these realities have already becomeevident. For 
the faculty, it u a time of reduced job nfiobility, stabilized 
department origan izationt a limited infusion of younger staffs 
and more selective rank and tenure processes. Forstudents» it is 
a time of larger class sections and a reduction in the variety of 
courses being offered. Few new buildings and decreased re- 
modeling and maintenance budgets suggest that those depart^ 
mcnis that did not get their new facilities, onemodeled laboratoryp 
or major new equipment ''before the valve closed'* may needto 
accommodate for a long, long time* This is the environment 
which is not verycondueivetosustaincdentbusiasm or program 
viability, litis is the environment in which renewal must take 
place. Thus, Jtisnotoniya matterofresourcesbutalsoa matter 
of spirit. Not only must new resources be obtained through re* 
allocation, but new ideas must benurtured and newenthusiasms 
kindled in an environment conducive to massive depression. 
Organizational analysis does not propose to be a wonderful tvew 
resource management elixir. It does suggest an approach to 
finding t£ve means for renewal if there is the desire. 

Or^anfzaUonal Analysis— Cataloging Activities 

Ofif anizational analysis is undertaken to achieve a number 
i'f objectives; 

I. To see if current f\inctions can be achieved at lower 

costs 
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2, Tq see if greater service can be provided using the same 
Of higher levels of support, 

y To descrtl^e these alternatives m a manner ^^hich ^^j|| 
assist the decision makers when it is necessary to make a ehoice. 

Colleges and universities have grown inetementally, A ■ 
prograni or an activity was undertaken at a particular time 
because, at the time, it was considered desirable to satisfy son^e 
need. It ts probable that the activity was added on to the 
organization rather than integrated into the ofganizaticn. It is 
highly probable that the new activity was undertaken by adding 
new people rather than increasing the work load of existing 
staff. Iti the Parkinson (1957) tradition* whatever the original 
need or intent, enough activity has since l^een generated to keep 
eveiyone busy. Organizational analysis begins with an audit to 
record what is taking place — who is doing what and for what 
puipose? It should be remembered that an activity might be 
accomplished at a lower cost by combining it with another. Or, 
the activity might provide a higher level of service, at the same 
cost, if It were performed in a different manner. Or, the activity 
may have acquired a higher pnofit> in toda>'s environment 
(career counselling, for example). On the activity nfiay have 
outlived its usefulness. Few participants in an activity will 
volunteer that it be discontinued, and this is the wa> it should 
be» since no one can perform ade<]uately who ean see no 
puipose in the activity. Relative pnoiities can only beestablisbed 
at some higher level in the organization after the case has been 
made* To insure that organizational analysis leads to renewal, 
and not Just retrenchment, the appraisal stepshould incorporate 
an activity which has been called IDEAL^. 

IDEALS 

Nadlcr ( 1967) proposed the IDEALS approach, an acroti^m 
for Ideal Design "f Effective and Logical Systems. This tech- 
nique IS included in the appraisal step of organizational Analysis 
to insure that the potential for renewal is developed. The 
IDEALS approach insures that as an activity is being appraised. 
Its total potential is considered. IDEALS suggests that the ideal 
way to accomplish the purpose ofan activity Should be developed 
and included as part of the appraisal to identify additional 
alternatives open to decision makers in the evaluation phase of 
organizational analysis. It is possible that the ideal wa> may be 
accomplished with no more, and even with less, resources. This 
approach requires: 

1 . An emphasis on activity or system purpose, not on the 
procedure or the organizational structure 

2. The development of the ideal way to achieve the 
purpose or function by considering- a great number of otnCf 
possibilities 

3» The identification of the ideal way to accomplish the 
function. It may be necessary to modify the selected ideal 
approach to fit (he realities of today. Nevertheless, all pos- 
sibilities will have been considered, and a listing of potentials 
(the IDEAL way) can become the basis for new goals for 
futu^ achievement. 

It can be seen that by not concentrating on what is wrpng 
with a current activity, which forces participants into a de- 
fensive position, it is possible to identify what must be done to 
satisfy the prioKtics that arc selected. 

Cvaluatlon> A Pr«llmbiary Step to Decision Making 

Having completed the first step in organizational analysis 
— appraisal — it is then necessary to bring together all of the 
information in a form suitable for use by the decision makers. 
The ideal fomiat for presenting the appraisal of an activity is a 
singlcshcct of paper. Any more detail ^^iH binder the selection 
process^ cince it is desirable for the decision makers to be able 



to grasp the totality of the organization. The evaluation or 
consolidation which precedes the decision maker's selection 
activity shoukJ provide an analysis which presents for each 
activity the following: 

1. Its purpose — What function does the activity serve? 
How does it contribute to the achievement of 'h'* institution's 
mission? 

2. hs^kistoty — When was the activity initiated and for 
what purpose? What ha: been the history of its growth and 
development? 

3. its possible reduced cost—Csn die fiinction be achieved 
in a less elaborate manner at a lower cost? What reduction in 
services would result? 

4. Its possible combination with another activity— Cou\<A 
the activities being performed be assigned to some other part 
of the OTganrzation? Could two simplified activities be combined'^ 

5. Its possible restructuring — Can the activity be re- 
organized so as to provide greater services at the same cost*^ 

6. Its possible enlargement^DV\ the IDEALS process 
suggest that this is an activity that should be expanded to l^etter 
meet contemporary needs? 

While ultimately ill activities are translated into their 
dollar cost for budget pitposes, this is not the emphasis at this 
stage of an organizational analysis. Tlie emphasis is on purpose: 
what are we doing and why? And, then* should we do more or 
less of it in view of today *s needs? 

At Santa Clara, for example, all classrooms had ortgtnally 
been assigned by the Office of the Registrar Then, later, an 
office Was created to coordinate conferences. It assumed re- 
sponsibility for the scheduling of classrooms on weekends 
when they were most used for conferences. This office also 
arranged for meals* housing in the dorms for conferees, aiid 
other non-classroom facilities. A third office was created that 
is concerned primarily with housing of undergraduates during 
the school year when the donns are not available for confetenccs. 
This organization developed as the university grew from 1200 
to 4600 students. An organizational analysis would provide a 
careful review of just what functions are being served, how 
well, whether or not they could be consolidated as a single 
activity, and whether Santa Clara could then take on additional 
conference activities for which there are no funds available at 
this time. 

Academic activities would be reviewed in the same man- 
ner (activities which make up academic departments, not the 
department as a unit). To assist in this appraisal and to evade 
the errors in unit cost analysis, Paidcn (1977) proposed that 
standards be established by policy for class sizci teaching 
loads, variety of elective courses available for department 
majors* and similar factors, and that the variances from these 
standards then be used for discussion In the appraisals IDEALS, 
evaluation, and selection process. 

How docs organizational analysis differ from the zero* 
based budget approach? It does not demand ttic effort to go to 
zero and back up. It accepts the reality that few colleges and 
universities will eliminate departments or activities to meet 
Current needs. Activities wilt seldom be eliminated and then 
probably only in times of genuine crisis. OiganiEationat analysis 
seeks renewal in a no-growth climate. Renewal is ^ necessary 
pieiequisrtc to sustained institutional viability and necessary 
for the people who staff its activities. 

Renewal Activities 

Stjechy's(l976) best scllerfoj^a^^y isa rcmindcrthatall 
of us have predictable crises of adult life She suggests that the 
final choice of the middle aged is between renewal or calcifica- 
tion and, furtltcr^ that there may be a need to prod the resigned 
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mid(Jte-agc(i person towanJ seeking renewal and rcvitalization. 
I see a parallel between individuals and the no-growih> or 
middle-age; gpsture colleges and universities have suddenly 
encotlnfered, A. stimulus or prod is necessary now that the 
challenge of growth and expansion has faded. Organizational 
analysis seeks to identify where (hat assistance would be most 
beneHcjali hQW it might be given and. if resources are the 
roadblock to sustained vitality, whcfe and how resources might 
be shifted. The passages of life's crises that Sheehy describes 
are very real in ihe context of drastically reduced faculty 
mobility. The large numbers of young faculty hired after 
World War II are now middle aged and beyond, I sec calcifica- 
tion vs. renewal as the central problem facing institutions of 
higher education for the next twenty years. This renewal will 
require resources for faculty development programs and for 
redirccting energies. Organizational analysis can make it possible. 

Organrzattonal Analysis and tnstituttonal Research 

Organizational analysis might be undertaken by a unit in 
the finance office, possibly as pan of the budget development 
procedure. It can be directed outside consultant, 1 think 
it is mora appropriate that it be considered as a fonn of 
institutional research. The central focus is oathe purpose of an 
activity, how il might be enhanced, and where the acttvuy 
ranks relative to other coniemporaty needs such as faculty 
renewal or development. It i^ possible that the appraisal* evaJua- 
lion* and selection can be completed without requinng new 
dollars This would bo consistent with the idea of renewal from 
within. The utilization of the office of institutional research 
has several advantages; 



1, It is already an existing organizational unit, A new 
activity need not be organized, 

2, The institutional research office is familiar with data 
and information already available within the organization, 

3' The institutional research 'staff is trained to consider 
alternatives and to seek alternative methods for achieving the 
institution's mission, 

4, The institutional research staff fs already known to 
many members of the academic community and will ^ more 
readily accepted by them. 

Perhaps the remaining question is whether the academic 
comiTiunity will accept this kind of activity at this time, I 
believe the answer is unique to each institution. There appears 
10 be less enthusiasm on the part of both students and faculty 
for participation in govemance^to be part of the discussion, 
yes; to make the ultimate choices, no. Perhaps this is because 
the size of the pie to be shared has diminished. Perhaps a is 
because future directions are not easily developed by com- 
mittees or groups The undertaking of organizational analysis 
requires that some pan of the college or university administra- 
tion provide the necessary leadership to seek change (renewal^ 
in a lime when the no-growth syndromic has severely diminished 
the capacity of members of the academic community to be 
introspective If they are convinced that the new students who 
arrive each fall deserve some of the excitement and enthusiasm 
that existed when there was growth* then they will participate 
in on activity that can help sustain viability while we advance 
through the next passage. 
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If "'the iTCcd Tor evaluation rarely occurs in an atmosphere 
of complacency" ihen the nature, structure, and conditions 
related to cnminaj justice educational programs are ripe for 
such an examination. For^ after an era of near geometric 
growth in the number of criminal justice programs, the Held is 
entering a period of intense controversy concemti^ the <)iiality 
of its curricula' This debate centers lar^gely on the development 
of rigorous criteria by which such offerings may be evaluated. 
In fact* many of the major national criminal justice organiza- 
tions, jiicluding the fntematfonal Association of Chiefs of 
Police, the Police Foundation, the American Society for Publk 
Adinintstration, and the Academy of CriminaJ Justice Sciences* 
all are wrestling with these problems. 

The purpose of this paper is to argue for a hiatus in this 
controversy so that institutions of higher education can under- 
take a rigorous evaluation of the discipline. Hopefully^ the 
data developed in such research projects will provide informa- 
tion necessary for the constniction of stringent criteria within 
which criminal justice programs may b^ restructured. This is 
essential, for curriculum rcfomi hasabetterchanceforsiKcess 
if it is based on infomiation concerning how its faculty, ad- 
ministrators, studentSt and clientele (members of the various 
criminal justice agencies) evaluate the present and future needs 
of such an education. 

There is little evidence to show that this process was 
utilized to any extent during the period of intensive growtht 
and it is feared that the current movement to lesiiucturc criminal 
justice education according to certain philosophical precepts 
may also a<i3^^n^ without the benefit, of rigocDu^empirical. 
research The following is ar overview of the development of 
both cnminal justice program, and the current move to upgrade 
these offerings. * 

Criminal Justice Education: A Survey of Current Trends 
Jn the past ten yearst many of the nation's colleges and 
universities have tnttoduced programs in criminal justice edu- 
cation. This movement has focused on present and future 
practitioners in the criminal justice system: on police ofTkcrs, 
corrections officers, coun, parole and probation officers, as 
well as planners and managers in all of these agencies. Where 
^ decade ago only a handful of criminal justice education 
programs existed in collcgeSt today these programs number 
well over 1*000. When mostof higher education moved into a 
posture of steady-state programs and budgets, education for 
careers in criminal jtistice showed dramatic annual increases 
(Annual Report, J973).' 

The impetus for this^sxpansion of criminal justice educa- 
tion came largely from the federal govemmcnt. The several 
presidential commissions that were organized during the 1960s 
to consider the problem of crime in the United States concluded 
that increased professionalism in the police and other agencies 
was a prerequisite for improved effectiveness of the criminal jus- 



tice system** The commissions' recommendations were given 
practical force by a second initiative^ the provision of sub- 
stantial amounts of student financial aid for in-scrvjcc police 
and corrections officers through the Law Enfbreement Educa- 
tion Program (L£EP).^ This made it financially possible for 
thousands of ^^lice and corrections officers throughoui the 
country to aitend college.'* 

While some institutions with prior experience in this field 
built on existing foundations of faculty, curricula, and scholar^ 
ship* others improvised. Where many of these have identified 
and established promising and innovative curriculat others 
have developed marginal programs of <)uestionable iong-tem^ 
value. In addition, few* if any> of the newly developed pro- 
grams have been based on careful research and evaluation. 

This problem was clearly articulated by Hoover in his 
recent mor*ograph* Police Educational Characteristics and 
Curricula (1975). In this wOrk> he identified the following 
deftcienciesof criminal justice cdtitction which he found to be 
especially prevalent at the community college level. 

h The curricula comprise far too many vocationally 
oriented courses. In some instances these have comprised 50 
percent or more of a student's total course work. 

2. The quality of the course offerings was frequently 
deftcientt with far too much emphasis placed upon courses that 
Only prepared students to perform specific tasks. 

3. A broad theoretical orientation to the entire criminal 
justice system and process was almost entirely nonexistent. 
Most programs tended to focus exclusively On only one com- 
ponenLoLthc system^_ .— 

Given the virtual explosion in criminat justice programs, 
it is not surprising that such a concern with the quality of these 
programs has developed and flourished. Jndeedt the major 
national criminal justice organizations mentioned earlier have 
indicated considerable interest. Their cOncems can be divided 
into two broad areas- One is associated with the credentials of 
faculty. The other is related to the development of ligorous 
criteria through which quality control of criminal justice cdu- 
cationat programs can t>e facilitated. ' ' 

The point which must be emphasized here is that the only 
mechanism by which change can legitimately be sustained or 
rejected is through a process of rigorous self-cvaluation. In 
dealing with criminal justice education* two seemingly con^ 
flicting goals must be met* On the one hand* the programs 
must be academically viable and acceptable. On the other 
hand* courses must be offered which deal in some way with 
issues and problems facing criminal justice practitioners. In 
addition, criminal justice is really a non-systcm with each of its 
component parts existing within its own encapsulated environ*^ 
ment and operating where information is both incomplete and 
uncoordinated (MushenO, 1976). 

When we at John Jay College of Criminal Justice began to 
confront thc>e same multi&ceted problems of sel f-c valuation t 

' 157 



CRIMINAL JUSTICE EDUCATIONAL CURRICULA 



vtc JcveJopcd anj inMitutcJ j ^,omp^lchcn^Jvc s>^tcn1K ic\t 
appraisal program. Wilhin lhL^ kivc been mcJiuJcJ an absc^^ 
mcnt both of the sc^vicc^ and facilities of the s,oIlegc and an 
InvcUij^ation of Al ^,on^titucn^,> jnd s,hcntclc g^uup^ affci.tcJ 
by our programs. To facilitate this, we generally followed the 
approach suggested b> professors Coates and Miller (I973J, 
The) have suggested ihai a three tiered approach be utdjzed 
Vthcn unJertakinc: evaluative research. This J^ ^,ompo^ed of 
mimcdiate* ^hort run, and long run ^,on^,t:rn^, When inipk- 
mentinj^ th^^. wc felt that data ^hould be generated jn the 
following n^ca^: 

L The models of criminal justice education (program 
goals) 

2. The valu^ assumptions inhenpnt in each of the models, 
ins^lbding ^uch subgoak a^ t>pcs of fa^,ult>, relations v^Jth the 
rcLt of the universit). student^t and criminal justtte agcncjcs 

3* Relationship between program gonis and program 
structure 

4. Future directions in criminal justice education. 

The program developed to accomplish this was compnscd 
of four elements. First, there was an evaluation b> students 
(alumni, undergradunle. and dropouts) of how the program 
affected their personal growth and career developrnent. Next, 
facult> and administ^ator^ were asked for their perceptiops and 
evaluations of the programs, resources, and facilities of the 
college. Thirdf criminal justice agenc> personnel were re^ 
que&ted to evaluate the relevance of the present baccalaureate 
programs, Rnally, the general public was asked to assess the 
extent to which the college's prograir) was revelant to com- 
munity needs. Given the systemic nature of this inquir>, it is 
hopol that it can serve as n model for the self-evaluation of 
criminal justice programs. 

The student element was designed to coordinate the de 
vising, rc^tr^cturingt and offering of degree prugram^ relating 
to student's personal growth and cnreer development. On the 
one hand, an jncrt^ase in the intellectual and personal maturation 
of students is sought so that they might be more sensitized and 
better equipped to understand the problems (personal agency, 
societal) with which they must deal. On the other hand, these 
people must be prepared to assume activcand productive roles 
in cither the criminal Ju^tice ^y^tem or some other sector of 
public Msrvice. Jn actompll^hing thL^ goal. pronM^ing students 
from a variety of backgrounds may well be recruited into the 
s,riniiual ju^tKC .uaciii making it both more re^ponMvc to and 
reflective of the general publit. In addition, ^uch pfogram.v, not 
only produce mi»re effective poli^,e-Lurre^,tion^- probation 
fifficers but they also provide the agenLie^ with a cadre of 
middle- management and upper-command- level personnel who 
arc capable and well trained for such positions. 

With this in mind, the establishment and institutionaliza 
tlon ofan ongoing formal relationship with the criminal ju^ti^,c 
agencies in the New York City metropolitan area was felt to be 
es^ntial. This was important for a number of reasons. For 
one, only the agencies are in a position to accurately define 
their present and future manpower needs as well as to identify 
tho&c issues Ahichaicmost important to the field, ForaiH)ther. 
a constant interchange between John Jay College and the 
agencies keep^ both continuously aware of the att^vLtie^ and 
concerns of the other. In additioni those in the agencies are 
kept apprised of any research or curricular Innovations whtth 
arc of concern to them. Finally, such a liaison allows the 
s,ujkgc to obtain information nc^,e^^a£y for the cvaluat*on of 
baccalaureate programs. 

Jn addition to this relationship with the agencies, it was 
felt that John Jay must develop and maintain a good rapport 
with the general public. This is being done in a variety of 
ways. One Is providing public service forums on selected 



top^^ and requesting the partJs,ipation and support of the 
public. Another js serving as ^ information agency for the 
va^iou^ segm&at^ of the public by providing p^evi^e data for 
^uch i^^ue^ a^ the fllandatc^ and limitation^ of s,riminal justKC 
agencies. 

Finally, it was essential to undcrstanu how John Jay's 
fas,ulty, administrators, alumni, and undergraduate ^tudent^ 
pea'eive^ the present and futtfe need^ of criminal ju^tlce 
agencies. In accordance with this, their perceptions and cvalu, 
ationsof the programs, resource^. and facilities of the college 
were systematically and rigorously sought. Such informntion 
was necessary in order to gauge how the various constituencies^ 
within the college assessed (a) the resources and facilities at 
their disposal, and (b) the manner and effectiveness with 
which students were prepared to assume their roles as pnrttci" 
pants in either the criminal justk c ^ystem or some other aspect 
of public service. 

Methods 

We now turn to the program adopted in pursuing the 
appraisal as weU as the general evaluative design within whiCh 
the research and develop men t were carried out. 

The major purpose of this inquiry is to establish a cur- 
nculum which MVill help to maintain John Jay's highly respected 
position in the field of criminal justice education. The central 
question in this regard is which type(s) of offerings will best 
meet the need^ of our^tudcnt^, criminal justice admini^trator^f 
nnd the academic fiekl of criminal justice. 

At present, there appear to be three general foims of 
criminnl justice curricula (Hoovcri l975.Tenncy, 1971), These 
are, (a) professional-man^enal, (b) technical -vocational, and 
(c) human is tic- social. The first of these stresses management 
skills needed by senior agency administrators and generally 
offered in a business administration context which tends to 
deemphasize soeinl science and humanities courses. 

The second approach tends to emphasize development of 
competency in the specials, skills deemed essential for cnminal 
justice practitioners. Finally, the humanistic-social approach 
attempts to develop the "whole person** so that he or she 
might better understand the problems of society and the milieu 
in which they are prevalent. This sort of program tends to 
dcemphasize the development of speciHc skills> whether agency 
or managerially oriented. Since (he primary concern of the 
overall project is curriculum establishment^ the central aim of 
the research phase is to develop the hard data necessary for 
administrators to ascertain which approach or combination of 
approaches best fits the future needs of those involved with 
criminal justice education. 

In attempting to achieve this goal, an evaluative process 
was designed to cover four phases, from clientele and constitu, 
cnty inp'jt through program establishment and rcevaluation. 
Throughout the first phasc^ construction of the research instru- 
nncnb wastlobel> coordinated to allow for prcs,ise companson^ 
of the views of respondents^ both within and between groups. 

In order to routinize thcdata collection proces^. an iterative 
tes,hniquc was employed whereby opioions were sought first 
from the leadership and then from the general populace t^fca^h 
participating group. Once the data had been collected it wa^ 
prepared for analysis by computer. 

In Jine withthisr the initial phase of the research called for 
contacting and requesting client groups to voice their opinions 
about the nature of criminal justKc education, the present and 
future needs and directions of criminal justice agencies, or the 
programs, services, and facilities of John Jay GDllegc. The 
first, and one of ihe two most important, groups to be contacted 
in this regard were those associntcd with criminal justice 
agencies located in the New York City nuctropolitan area. All 
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segments were asked eo partieipate^ ineluding the various 
police departments (New York City, Housing Authority, 
Transit Authority, and Pot* Authority)* corrections departments 
(Correetions, Probation, and Parole), and the courts. Initially, 
eommand personnel were interviewed at eonsiilerable length 
with regard to their views of education generally, criminal 
justiee edueation speclfteally, and training as it affects their 
petsonnel. The discussions ranged from broad overviews of 
the topics to extremely spedfie references to courses or training 
procedures which respondents wished to have emphasized for 
those in their employ. The purposes of these inquiries were 
multiple and included: (a) ascertaining information about the 
managerial skills and concepts adjudged essential for criminal 
justice administrative personnel* (b) acquiring information about 
specific course offerings* both needed and desired, and (e) 
establishing John Jay as a resource center for the agencies. 

The general personnel of these agencies were then surveyed 
by means of structures questionnaires, which were distribtited 
in proportion to the number of individuals at each rank. The 
opinions elicited concerned perceptions of their departments' 
training and educational needs. It 'is from these responses of 
both command and line personnel that perceptions of the 
present and future needs of criminal justice agencies will be 
determined. 

The second of the major groups to be contacted were 
those connected with the college. Thus> students (undergradu- 
ates, alumni* and dropouts), faculty, and administrators were 
asked lo express tlieir opinions concerning the nature of the 
needs of criminal justice agencies, criminal justice education 
generally, and John Jay*s programs specifically. While the 
survey instruments for each of these were closely coordinated* 
a slightly different focus was established for each group. 

The questionnaire administered to factjity and administra- 
tors dealt with a variety of issues. Among these were items 
concerning the following: 

t. Tic nature, background, and role of the faculty mem- 
bers within the discipline 

2^ The relationships existing between criminal justice 
agencies and criminal justiee educators 

3 The objective of faculty members with regard to stu- 
dents and their caieeers 

4 The philosophies of criminal justiee edueation whkh 
are held and implemented by the respondents 

5. Programmatic concerns 

6. Demographic data 

7. The nature and quality of John Jay's services and 
facilities. 



The segment addressed to auministrators and senior faculty 
members was broadly worded and opcn-endcd, while the 
segment submitted to the general faculty was far more explicit 
in jts presentation. The questionnaire designed for the student 
cohiponents also followed this latter explicit style. Beeatisc 
students' concerns differed from those of the faculty and 
ad ministration^ the focus for this element was shifted somewhat 
to include such issues as: 

1. Why they initially entered John Jay 

2. Why they remained/ withdrew 

. 3. Evaluation of the resources and facilities 

4. Quality of the general curricula 

5. Quality of the criminal justice curricula. 

Tite coordination of these survey instruments with those 
used for general faculty and agency personnel is allowing 
analysts to detennine the consonance, dissonance^ and relative 
accuracy of the respective views. 

Next, the general public has been contacted. At this 
point* both urban and suburban residents are being surveyed so 
that the extent and accuracy of their knowledge about the 
criminal justice system and its practitioners* as well as thejr 
views toward criminal justice education^ may be ascertained. 

A fourth group to be interviewee were faculty members 
and administrators of selected criminal justice j^rograms as 
well as the general profess(3riate of this field throughout the 
United States. Once again, the two-tiered technique discussed 
earlier was used. In theiirst stage, the leaders in the field were 
visited on their home campuses and interviewed extensively 
according to an openn^nded interview schedule. On the basis 
of the data gathered during these visits^ a structured question- 
naire was created and distributed to criminal justice educators 
generally. These were the same instruments to which members 
of the John Jay faculty were replying. Therefore* another 
situation has been presented in which the perceptions of those 
associated with John Jay can be compared with individuals 
situated at other institutions. 

Once these investigations have been completed, a vast 
amount of infoimation will have been gathered. This will 
range from the general overviews offered by agency and aca- 
demic leadership to the specifies presented by criminal Justice 
practitioners, professors, students* and the general public. 

This information will provide the necessary data for those 
at John Jay to detennine whether or not tlwir programs are 
meeting the educational goals. The data also should provide a 
pathway for appropriate curriculum change. 
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The measurement of the outcomes of higher education is a 
philO£(^hical as welj as a practical issue. Certainly it is neces* 
saiy to measure impacts of higher education, even if some 
cmbairassmcnts result. If higher education \s, in fact^ doing 
less than an adequate job with the sources it ts granted, the first 
step toward impelling and motivating and facilitating improve- 
mentis to document the shortcomings. And there will be short- 
comings. But if the ability is acquired to measure compre- 
hensively the wide range of the outcomes of higher education, 
the shortcomings wiJI be overwhelmed by the documentation 
of an *array of bcricfits of eveiy sort which now, in varying 
degrees^ go unacknowledged. 

Vctt what ought to be done and what can be done are 
different matters. And it is the latter question, the feasibility of 
measuring a meaningfully broad ra;!ge of the outcomes of 
higher education ^ that may be more tinfusly* and even urgent, 
because the notion of outcomes nteasdrcment is rapidJy gaining 
favor with institutions. Outcomes arc suddenly quite the 
fashion, as the National Center for Higher Education Manage- 
ment Systems (NCHEMS) discovered recently when it launched 
a new outcomes assessment workshop with the Educational 
Testing Service (ETS). In shon order, the workshop was 
overbooked, and NCHEMS is now considering whether to 
extend the series and accommodate a long waiting list of 
would-be participants. 

This new interest in outcomes has spurred R&D efforts — 
by ETS, by NCHEMS. by the American College Testing 
Program (ACT), and others. And so it is a good tinne to 
remember that renewed interest and redoubled effort will not 
in themselves gtiaramce success. Success is commonly assumed 
to be a function of effort — if resources are plentiful enough, 
any problem can be solved. But efforts to analyze the impacts 
of coJJegc education date back 40 years ormore^ and the art is 
still in a very primitive state. Kenneth Feldman (1970) wrote, 
in an ACf research report* ... it is certainly true that our 
knowJcL^e is not very great, given the immense amount of 
effort that I as been exerted in research, analysis, and discussion 
of college effects. (p. I) Our ability to measure outcomes 
now is, substantially, no greater than it was in 1970. though 
not for the lack of trying. 

There has been a growing interest, then, in identifying 
and measuring the outcomes of higher education — and a record 
of slow and spotty pro^ss. The new impetus toward the 
measurement of outcomes ij; easy enough to understand. Jt is a 
direct outgrowth of the rising awareness that higher education 
must be more accountable and credible because resources are 
being ever more closely linked to accountability — and clearly 
are going to stay Jinked. But the assumption that measuring 
outconfies is the best and most direct way to become more 
accountable is fargeJy an unexamined proposition. It is, how- 
ever, one that needs to be examined. We should lock both at 
what constitutes accountability in higher education and what 
constitutes valid measures of outcomes in hfgher education. 
The concept of outcomes has many dimensions* of course, but 
five seem to be of predominate concern today. 



First, there is the concern for efficiency — the conviction 
that higher education should perform its functions>at the least 
possible cost. 

Second is the matter of effect ivervess — the responsibility 
of higher education to do its job well, to produce outcomes 
appropriate to need and expectation and of good quality. 

Third, accountability requires evidence of productivity- 
evidence that higher education produces both a quantity alid^ 
quality of benefits whose value equals cr exceeds the value of 
the resources used in producing them. 

Fourth, higher education is expected to be a good invest- 
ment, in the sense that dollars expended should yield returns 
that are more highly valu^^ than would the returns from 
making the same invesinv t in another social enterprise. 

And fifth, aeeountat li f demands that higher education 
demonstrate its social respor ibility. In producing valued out- 
comes, higher education is expected to perform according to 
prevailing notions of justice, equity, and fairness. These pro- 
cess characteristics are, in effect, desired and demanded service. 
For higher education to be socially responsible is to achieve a 
kind of outcome — a m^ans that is an end in itself. And, to an 
extent, other ends must be tempered by the means— by the 
need to achieve and maintain process charaeteiistics that are 
socially responsible. 

There are other dimensions and factors that help compli- 
cate accountability. But these five make it immediately ap- 
parent that the whole business of accountability is largely 
subjective. Effectiveness, good investment, social responsibility 
—all these demand value judgments. And the special nature of 
higher education funher complicates the problem of aocoi 
ability. Three general characteristics need to be considered. 

Firstt higher education is like a factory to the extent that 
it is expected to produce tangible things. It must turn out 
holders of degree? or certificates who have acquired varying 
levels and qualities of ki^owledge or competence, as well as 
research findings and various services. Most colleges and 
universities primarily produce gi^duates or program completers. 
But, unlike a factory, a college docs not have close control 
over its raw mat- .lal— that is, its students. Students are at the 
same time workers'and raw material. In good measure, they 
shape and reshape themselves, utilizing the environment and 
facilities of the campus. The^ institution's roie in the teaching- 
learning process is certainly not passive. But the institution 
cannot shape the student into a competent degree holderunless 
the student has, and exercises, the requisite ability. In a 
faetoiyt the machines do not care what they do and the raw 
material cares less what happens to it. In higher education, raw 
material must be a willing and active participant in the process 
if something of vahie is to be produced. 

The second complicating characteristic of higher edueotion 
is that its institutions must not only do but be. Like a park or a 
public auditorium, an institution provides a setting conducive 
to a desired experience. The quality of setting has much io do 
with the qi>ality of education outcomes. A quality academic 
seUing can be expensive to build and to maintain. 
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FinaJI> * higher education ha^ the upcommon charactcnMK 
that It for the mo&t part* supported by taxpa>er^ MvhoM: 
elected reprc^ntative^ have expectation^^ of higher education 
that are different, ^omctimc^ radieally dirferenL from the 
expectations of the direct users of higher education. In the 
legislative mind* questions of cost and social responsibility are 
uppermost. The first concerns of most students aie program 
diversity and i]ualit>. Those who make use of university re- 
search and other services are Similarly interested in diversity 
and quality. 

Other factors enier th<^ picturct of course, Bui even if 
consideration is confined to the four dimensions of account- 
ability and the three special characteristics of higher education 
diseussed above* it must be recognized that accountability 
involves immense complexities and demands difficuh trade- 
off decisions. 

As between elTiciency and effectiveness* the trade-offs 
arc fairly stratghtfor^vard* in principle at least. Producing 
soniethin^ cheaply is not a virtue if efficiency is achieved ^t 
the cost of utility and durability. On the other hand* making a 
product useful and durable docs not guarantee that the inteivJed 
user will be able to afford it. 

Effectiveness also may have to be traded off in the name 
of social responsibility. An institution tnay be expected to 
provide access and special programs for rctattvely less capable 
studenis. But student ability is a substantial component in 
program effectiveness and efficiency as wejl. Social itsponsi- 
bility may mean spending more to produce less. 

Suppose* hov^ever* that ^hen those trade-offs have been 
madct an institution is still able to dcijionstraie that it is 
operating with reasonable efficiency and effectiveness. This 
docs not make it necessarily and automatically a good invest^ 
ment for public dollars* because the money might bring a 
higher return if invested in some other social enterprise. 

Moreover, how docs one justify investment in the institu- 
tional environment — in the creation and maintenance of those 
park-like qualities noted ^ve? How docs oiib demonstrate 
the contribution that such qualities make to efficiency, effec- 
tiveness* and investment rctum? 

How confounding the accountability requirtement can be 
when all those trade-offs involving efficiency, effectiveness* 
M>cia] responsibility, and return on investment arc taken into 
account- Can one reasonably expect that the identification and 
measurement of the outcomes of higher education can be 
improved and extended sufficiently to be of real use in the 
acvountabiltty process? Will such advances be cost cITcctive? 
for, ifanything has ^ecn learned* it is that collecting outcomes 
information is expensive. Driving up a ^Imini strati ve costs is 
hardly the way to improve an institution'sefficicncy rating. In 
any case* as an R&D undertaking* outcomes is unquestionably 
lodged in the high-risk categoiy. 

Granting that nsk of failure is high and the list of seeming 
imponderables in the outcomes area is long* one must consider 
the risks and the costs of not advancing the ^tale of the art and 
applying whatever oulcomi'^ measures can be developed. 

The first and worst risk is that the purely numerical* 
efficiency- biased perspective will continue to predominate atid 
probably increase its domination of the accountability arena. 
Throughout higher education* the student credit hour is de^ 
noisnccd as an invalid measure of efficiency or effectiveness, 
Harold Hod^inson said it best— "no one hasever felt, smelted* 
or heard* or seen a credit hour* A credit hour is simply a 
measure of time spent in a place of instruction in the presence 
of some instntcttonat medium" (1976, p,4l), Dr, Hodgkinson 
IS exactly right, Studcnt/faeuJiy ratios are, jn and of ihcm^ 
selves, equally useless indicators of productivity. All such 
formulations, no matter how precisely calculated* are essen- 



tially nfianife stations of unit^cost economics Unit cost !s an 
ideal productivity indicator in industi>, because it is applied in 
the Ughtof other known quantities. A factoo knows with grear 
precision what it is producing. The unit of production is 
prec[^ly defined* its uses and quality are known, and its 
market value is easily determined. But. so long as one does not 
know what a student credit hour i^pi^sents or ^vhat its content 
is* one cannot know what it is worth and* therefor* cannot 
know whether the cost of producing it is too high 

Yet this bottom-line ecoiiomic perspective* which any 
fair minded analysis exposes'as a faulty conception if applied 
to higher education, is a! present the most commonly used 
accountability indicator. In the long run. this kind of account 
ability will lead higher education av^ay from many of its true 
lesponsibilities and* eventually* into trouble ^^itli its constitu 
encies, the public at large* and its own conscience. Account- 
ability dominated by that perspective summarily dismisses the 
value of environmental factors and the value of institutional 
efforts aimed at discharging social responsibilities. The use of 
such measures of efficiency is a way of shonchanging not only 
higher education but all of society. If society is no^ to be 
shortchanged, :hese simplistic and distorting t:nit-eo5t measures 
must be supplanted by a wider variety of more appropriate 
outcome measures. So. unless one has forb'dJing evidence 
that the development of outcomes measures and indicators is 
patently not feasible* there h a clear social imperative to 
proceed. And there are many signs that the climate ha;^ never 
been better for such efforts. The growing sense of need for 
better outcomes measures certainly can be ntiade to harden into 
commitment. How then to proceed? 

Howard Bowen (1974) has put forward four steps by 
which institutions can attain true accountability They const! 
tute a sound approach, provided that a Hfth step is added I^r 
Bowen's four points are the^: 

1- Define institutional goals and order their priorities 

2. Identify and measure the outcomes of institutional 
programs, 

3. Compare the goals and outcjues and then judge the 
degree to which the goals are being achieved, 

4. Measure the cost and judge the degree to which it 
approaches a reasonable minimum. 

The fifth step that should betaken to determine whvther 
the outcomes produced arc a better buy than other cutu>mes 
that the public^might purchase with the same dollar In the late 
fifties and ^ixtte^those years of plenty that can be r&.a*^cd 
with such nostalgia— *iuest ions were raised from time to time 
about the pell-mell growth of higher education and its cost 
These objections were iisually not motivated by a desire to 
make alternative use of the sources involved, however, and 
perhaps that is why they did not prevail But today, the 
competition for public resources is real and severe, and it will 
continue, to be so* even with the return of economic good 
times. 

A legislator may concede that a college or university i^ 
operating efficiently effectively, and in a socially {^sponsible 
manner. He or she may have a sincere sense of the value of the 
institution's educational program% and may wish to b^x th<jT 
benefits made more v^idely available. But he or she n;usr a^k 
whether constituents do not value and need an alternative 
benefit* such a^ Improved or extended health care, even m- 'x. 
than good higher education. If it is to compete effcctivefy lor 
resources! higher education must be able to demonstrate that 
its outcomes are better and more valuable than those that mii^\\\ 
be obtained with the same investment elsewhere. 

Hard to do? Of course. And impossible to do unless the 
u>ncept of the outcomes of higher education is broadened far 
beyond the bottom line notion that is so pervasive today The 
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Mrarch for oalconics measures must be casi in a framework 
thai more udetjuately represents che total Eiesponsibility of 
institutions. ArJ, though this can be done, i( is not merely a 
matter of defining noorc outcome measures and developing 
techniqur^ for collecting the relevant Infom^ation. 

Future work on outeomes should accommodate several 
cons; id orations Fur one thing, one must make a clear, con- 
ceptual difterentiatio'^ be'wee^^ indicators of outcomes and 
indicators of quality-— that is, between impacts per scon the 
one handt and the quali y of those impacts and of the process 
that generates them on the other hand. Developing and main- 
taining an environment conducive to a high level of K xing 
and intellectual development is not an enc* in itself thi: 
purpoMS of aceountability, the cost of a quality inc^^tional 
environment is justifiable only to ^e extern > ,h\ ii can be 
shown to improve institutional outcon;es. Incfieat^>rs of quality 
are necd'td that gpply to components in the education process — 
faculty, students, curricula, and physical resources. But also 
needed fire other quality indicators that apply to instructional 
outcomes, research outcomes, and community-service outcomes 
— and one should not confuse process quality and c^tcomes 
quality. 

Morcover, outcomes measures cannot be viewed in bola- 
tion. The dcvelcpment of useful measures or indicators must 
take into account their intended analytical use. An institution 
has an array of outcomes whose interrelations must be under- 
stood and whose relations to indicaiors of process quality must 
aUo be understood. 

The generiil purpose, accountability, involves not oriy the 
ability of higher education to demonstrate that it makes justified 
use of its resources: it also implies a willingness on the part of 
higher education to correct dtfieienees and improve perfor- 
mancc, whciv possible. To do tlxat, one must understand 
relationships — s^ch tie effect tnat the use or non-use of 
teaching assistants in ilhiversities has on the cost and qt^Mity of 
graduate educatil^n The validity of such indicators must be 
demonstrated and made a matter of common agrceniem, not 
only withtn higher^ducation but between higher education and 
\^hat can be called the accountability .4jdience, with its mix of 
conflicting perspectives. These must be kept in mind when 
calculating the tradc-ofTs between the difTcrtng dimensions^f 
the accountability requirement. 

Despite the difficulties inherent in outcomes measure- 
ment, there is one concrete reason for optimism. Jt is found in 
a study recently compleied by one of NCHBMS^ senior re- 
searchers, Leonard Rom^ey, who surveyed more than 1,100 
fat^uhy, trustees, and administrators at 43 difTcrci.t colleges 
and universities to determine their views about their institutions' 
goaU and appropriate ntcasuies of progress toward ihosc goals. 
In essence, the study shows that within institutions, trustees, 
admtnistratujS, and faculty are pretty much in agreement re- 
garding what the institution's goals i'nould be. They also agree 
fairly \^'ell what measure*; would be appropriate for measuririg 
goal progress. A third finding, which is equally significant, 
wa& that most trustees, administrators, and faculty are skeptical 
tbout the validity of the productivity nvsasurcs in conimon use 
■I present. 

This study indicates that within higher education, at least, 
.riivc IS a climate of awareness for the need for better outcomes 
measures — pnd that p consertsus in higher education, on both 
objectives and measures, maybe much easier to reach than one 
might have thought. Nothing conduces more to succiss than 
the ability to pivscn, a comnoon front to dtflHcultics. 

At the same time, one has to deal with the fact that little 
knowledge exists about the different Values that various bene- 
HciHries of higher edtication would attach to the objectives 
upoiv which those in higher education might agree. One must 



find out what weight is given to specified objectives by the 
different groups to whom higher education must be accountable. 

That Jeads to a consideration of fundamental importance, 
a consideration that is most difficult to deal with; The advantage 
in deciding with some precision what are the objectives of 
higher education is obvious enough: then one would know 
precisely what he or she wants to measure. The standard PPBS 
approach to management would have an enterprise specify its 
obiictives in measurable terms— a tactic that makes excellent 
sense in settings where objectives can be agivcd upon easily. 
Measuririg progress toward such commonly accepted objectives 
is likely to be a straightforward process. And, accountabilhy 
would be simply a matter of demonstratir^ that the objectives 
had been achieved, effectively and efficiently. 

However, ^hat view of plannirig and accountability in 
higher education must be challcrigcd. It may be that, within 
higher education, a '. fil^^^i * common understanding of 
objectives can be achieved. i*ut it would be a veiy difficult 
task, indeed, toextend this commonality of outlook and expec- 
tation to all interested ponies in a democratic society. Even if 
thiscouldbc done, there is great danger for higher educaiion.in 
teachirig prior agrccnrtenis with the acfxiuniabilUy audience on 
a preclusive set of outcomes as a basis for assessirig efficiency 
and efreetiv^ness. 

Higher education must nevcx bc harnessed to, or hobbled 
by. a proscriptive set' of intended outcomes. Program planning 
should provide leeway resources and opportunities that are not 
specifically justified in terms of precisely defined outcomes. 
The value has been learned of basic research consciously 
aimed at Jittle more than satisfying the researc!ier's euriousity: 
that the unanticipated by-product of basic research may be 
worth far more thun the intended product. The unintended 
outcome may be of modest vaJue, Jike teflon, or of inmeasur- 
abje human benefit, like penicillin, or of awesome impact and 
ambiguous value, like the atomic bomD and all of its frightening 
progeny. The contribution of higher education to basic scien- 
tific rc*^ is well documented. It also has been discovered 
that there is a relationship between the volume of basic research 
and the quantity and quality of its umntendbd outcomes. 

There is little, if any, awaieness, however, of the extent 
to which the li^ ^ral arts produce unintended or unspecified 
outcomes from which unanti^ ';)ated benefits arc reaped. One 
i^ult is that the liberal ans '^'^ ^mng very poorly in the 
accountability arena today. The tenneney is to narrowly jusSfy 
college education in terms of induced career benefits. Ac- 
cordingly, such disciplines as philosophy, Uterature. and htsioiy 
arc said to have only a nebulous claim to resources for serving 
student majors because their only relevant employment would 
be in teaching, where (here arc no jobs. Similarly, an en- 
gineering program or a business school tends to be evaluated 
on the basis of how well graduates do in their fields of 
preparation. Should the graduate give up engineering, or busi- 
ness, after a few years, some fauU in his preparation is inferred. 
What ought to be done is to find out why people shift to new 
occupations, how well they do in them, and to what extent 
some unplannwl educational Outcome infltienced the shift. 
Should one fault the U.S. Naval AC£:demy because one of its 
graduates^^ trained for submarine duty, went into the peanut 
business and, subsequently, exhibiting still nfvorc irresolutiop, 
got into polities? 

- ::omcs-oriented planning for higher education must 
noLlead to the attenuation of the range of benefits that, in fact, 
emanate from higher education. Perhaps accountability should 
be addressed through outcomes-one nted as.tcssiTicnt, which 
measures outcomes after they arc produced rather than pre- 
scribing them in a limited fashion beforehand. Colleges and 
i*aiversitics must keep doing those things that result in graduate 

"IGC 



OUTCOMES 



engineers nsing iv the prcsiden(,> of the United Siute^^ — and 
there have been two instances of that, b> the \sa). Fuller 
accountability reqmras that wa>s be developed of measunng 
^njntended outcomes, as a first step to relating them to the 
process tharawtenstit^s in higher education that brought them 
about. 

To these can be added many other hurdles that impede 
progress towanl the goal of full accountability, which U the 



proper goal for outcomes research and development. Account 
ability is, at heart, a matter of critical assessment An observa- 
tion in Alexander Pope's Essay On CritUism is apropos, even 
though it ma> be viewed in some quarteis as chauvinistic. The 
poet notes that when one estimates the attractions of a lovel> 
woman, 

Tis not a tip, or eye* we beauty calK 
But the joint forte and f\ill result of all. 
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RESEARCH; AN APPROACH, SOME RESULTS, 
AND MANY IMPLICATIONS 
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, This investigation was initiated in the fall of J973 at the 
request of the vice president for academie affairs who authorized 
the Office of Institutional Research to conduct a prognun 
evaluation within selected aeademie units, fn retrospect, while 
the viee president was motivated by an upcoming requirement 
for a sclf'Study* in the Office of Institutional Research the 
interest extended to designing an approach which could be 
utilized for program improvement on a continuous basis. 

Following the vice president's direettve, the literature 
was purused and, in consultation with the academic deans, the 
following objectives were ^recd upon: 

L To orient dcctsion*making administrators to the acf 
vantages of the early development and continued use of the 
program e^valuation process 

2. To select from the available literature an approach to 
evaluation which appeared to enhance program growth and 
development 

3. To implement the evaluation modeJ in a limited setting 
while carefully n>onitonng its impact 

4. To make necessary nfiodifications in the model and 
then utilize it in a la.'ger setting 

5. To utilize the process university wMc for self-study 
purposes. 

Subsequent literature searches related to the outcomes of 
progra^n evaluation were quite frustrating, U proved difficult 
to obtain descriptions of what actually happens in program 
evaluations.* what is useful in the various models* and what Js 
not^ So. this investigation was initiated with only a limited 
understanding of what to expect 

T.^e purposes of this paper, therefore, include developing 
some potential for later replication as weJI as communicating 
the experiences of one institution with a particular pro^m 
evaluation modcL 

Methodology 

Following the deveJopnflsc^t of objectives, strategies of 
methodology evaluation were more fully explored. The work 
of Popham ( WIS) provl ies a useful scheme for their categori- 
zation as follc^vs: 

L Goal attainmem models 

2, Judgmental models emphasizing intrinsic criteria 

3 Judgmental models emr^hasizipg extrin.sie criteria 

4, Decisioi^-faeilitation models, 

Popham identifies Ralph Tyler as the principal sponsor of 
the goal attainn%;nt model wherein specific program goals are 
identified and translated into measurable objectives^ after which 
pupils arc tested to determine how well each objective has 
been attainr^d A program is evaluated^ then, on the basis of 
how many of- its objectives hav: been at'.aine^. This is« of 
course, the approach utili^d for the current National Assess- 
ment of Educational Progress, 

Judgmental models emphasizing intrinsic or extrinsic 
eritcri:* are categorized by their focus on the role of pioressional 
judgment The most commonly utilized illustration of the 



intrinsic variety of the judgmental model :s the accreditation 
process wherein specialists from outside the school examine 
factors associated with the process of edueatr:>n with Jjttle or 
no attention being paid to the products of education. Thus, 
visiting teams c^nt books in the libraiy, faculty with Ph,D/s, 
and the number of elevaters per student. 

Judgmental models emphasizing, extrinsic criteria, gen* 
erally associated with the writings of Mtcha.;! Seriven (J967) 
and Robert Stake (1967) place responsibility on the shoulders 
of the evaluator for* among other items; 

1 , Distinguishing among iormative and summative eval* 
u at ion needs 

2, Assessing the quality of program objectives 

3, Designing means of comparing ef^cts of different 
programs. 

Throughout the above, attention is paid to the product in 
addition to* or often instead of, process. 

The fourth crass of evaluation models, dubbed decision- 
facilitation by Popham* came close to matching the objectives 
developed for thb project. Most advanced by Dan Stufflcbeam 
et aL (197 1) and by the University of Califomia at Los Angeles 
Center for the Study of Evaluation (CSE), formatfy directed by 
Marvin AJkin(l969)} these models sti:ess, most fundamentally, 
the role of evaluation in enhancing the decision*inaking process. 
Essentially, they provide a methodology which both aids in 
raising fundamental questions which need to be asked and 
provides guidelines for resolving them. In faet> die decision* 
facilitation process uses elements of atl three approaches pre* 
viously discussed. The adaptation of theStufflcbeant approach 
and of the Center for the Study of Evaluation approach, which 
was utilized in this study, contained foir stages as follows: 

Stage I: Needs Assessmem'^\ti which the objectives for 
the program being evaluated are placed in the context of 
community needs. 

Questions of concern include: Arc there other programs 
like this one availabj to your clientele, which objectives are 
these other programs meeting; which objectives are not being 
met by any other progran^s; how may these objectives be 
prioritized in light of community needs', are we left with a set 
of objeetivf^s which fit with the total coHcgc or university? 

Stage 2: Program planning—l^ which the particular 
courses being offered are examined to see their relationship to 
progani objectives. 

Questions of concern include: How have other programs 
differed from this one in the array of courses, institutes, 
training programs^ etc, they have mounted to n%;et similar 
objectives, vifhat evidence is there that this particula'^ anay of 
courses is more likely to reach program objectives than any 
other arrangement; are cost factors rclevani? 

Stage i. Program implementation—In wnjch difficulties 
encounlercd in the installation of any program component are 
identified (such as budgetary limitations, space hmitations, 
etc,) 

Questions of concern include. Has failure to reach ohjee- 
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tivCk iwhKh 1^ the <^oiiveni of Stiigc 4j been due to a failure 
ptopcrl) implement ke> ^^omponent^ of the prugr^dm rather 
than a failure the progr4im it^lf, can Any mid'course <^oitcv 
tionb be made to im^rea^ the likelihotKJ that the program vnW 
be properl> m^tdlled* do ^e hdvc a prugram plan whi^^h ^impl> 
eannot be implemented? 

Siage 4, Ouu ome ass^ssmetit — In whieh it is determined 
vvhether program objectives are being attained. 

Questions of concern mcludc. Which objectives are being 
att^tmCd to the MtisfHttaion of planners* uf leamcrsF whii^h 
objectives ^trc not being attained, how does thi^ relate to the 
nee d^ asses smcntt at^ changes needed tn program pLnmn^ ur 
program implementation? 

With this strateg> de^^ided upon* meetings M^ere condu\;tctl 
^vith administration and facult> of the Sthool of Health ^tnd 
Social Services and the S<.hool of Hotels Food, and Travel, the 
rMvo units M^ltxted for ihe pthi phase the slud>. The puipcse 
»>f these M:s^jons vvas to attempt to explain the decision 
facilitation model. 

Implementation 

The four-stage evaluation began with a needs assessment 
for each program within the units. In this phasCi interviews 
Mvere <^ondu<^teJ with the program desdopcrs, and all literature 
related to the development of the program was read for the 
purpose of learning the particular needs the program was 
established to meet. One outcome expected from this effort, in 
addition to providing the foundation for later stipes, was an 
appre^^iation on the part of the prograir, olanner of the «-han^iiig 
nature needs and the desirability of staying up^^to-date 
relative to tk>se changes. At the ver> least, tt required planners 
to be aware of the rationale for thu establishment of their 
programs. 

In the second phase, program planning, the rationale for 
*he particular array of <^ourses offered to students was explored 
in relationship to the needs the program was designed to meet 
and to other methodologies vth^h could have been selected. 
An outcome hoped for was the developmei t of apian toenable 
f^ost/benefiE compansons to be condueted across the various 
methodologies. 

In the third phase, program implementation, the mechanics 
of the operating program were examined to identify discrep- 
ani^ics between the program plan and reality. This phase is of 
partii^ular importani^e in situations where failure to oblai,^ 
objectives refleUs ^ failure to properly install program rath<^ 
than a failure of the plan itself. This phase assisted the planners 
in developing methods of ' flaggmg ' problems before they 
were likely to have too signifleant an impact. 

Fourth, there was outcome issessnient* in whii^h data 
were ei^llccted from students partieipating in the program in 
order to obtain an indieation of whether they felt the prpgrain's 
objectives were being attained, Thi^ information related dtrculy 
back to the needs assessment pha^e where spei^iflc target 
objeetiveii were identified. 

The methodology chosen for outi^omc assessment wa^^ a 
tejeph<ine survey of graduates, using specially tramcd inter- 
viewers. It vvas felt that this would sigmficantly improve 
response rates. 

Results 

As to the results of this underta* ing. it is important to 
point out. firM ,)nd foremost, that there is now a climate for 
evaluation, a receptivity to Mvhat it i^an accomplish. The ^,tmc 
eh^ir opie who attempted to sabotage the process throufji 
long <te1aysi ^md seemingly endless requests for rewrites. noMv 
turn to the Institutional Research Office Mvhen an outside 
source ask^ them for follow up data on their graduates. It »s 



recommended that the best i^ay to prove one's objectivity and 
sinc'erity when those come into questionr and certainly these 
experiences suggest they wilh is to conduct one phase at a 
ttmci demonstrating a professioiul approach to all activities 
and» in particular* to the manner m ^^hich information relating 
to programs is treated. Evaluations are as mueh a part of the 
political process as they are of the researeh process, and 
evaluators need tough skins as welt as valid instruments. 

Secondly* afte' overcoming all of the abovCt results sug 
gest that It is posstule for data from ar: objective evaluation to 
impact a program. The data showed prc^ram weaknesses 
Mvhere planners didn""* knovv there vvere weaknesses. The data 
even showed some strengths v/hieh hadn^t been t>oasied about 
previously^ and revealed employment rates^ salaries, and ne^ 
needs which graduates had themselves </nty i^ently identified. 

A third conclusion relates to the other aspcets of the 
model. The results suggest that needs assessments arc probably 
the most difficult <and least rewarding) undertakings for on 
going programs. Ideal* the time to begin them is before a 
program is instituted s that the pr^tice of gauging needs is 
built into the program design. In order to insure that ongoing 
programs wilt engage in eontinuous needs assessment, it is 
necessary for the offiee doing the evaluation to ^upply those 
programs with simplified checklists and many guides to indi 
eate where and how this t^Jnd <>f data may be obtained. 

Program heads are simply not oriented toward eolleeting 
and examining needs- assessment -type data The same is true 
of the program planning phase Unless, and until* that point is 
reaehed when ehjef administrators rc<]uire justification for the 
..continuation of a given array of eour^es (and maybe that point 
is coming)t there is little likelihood of program heads giving 
serious eonsideration to alternative sequences and method 
ologies. Program implementation results have been most in- 
formative and most useful. Program heads ^ aeeustomed to 
gatheiing this kind of information^ albeit haphazardly* but 
rarely is anything mueh done with this kind of data Now, with 
its systematic letneval and analysis encouraged, program heads 
are better able to summarize their problems and needs. 

In conclusion, it is apparent that definite progrfs^ has 
been made toward aeoompllshing the objectives origuially 
developed for this effort* and there is some reason to be 
optimistic. Clearly, it has been demonstrated lhat program 
evaluation eosts arc very worthwhile. Just as clearly » however, 
there is evidence that continued efforts are required before the 
model will be fully "institutionalized'"— when year end repon.^ 
prepared by program heads ^utinely include analyses of data 
relating to needs asscssmcr. program olanning, program im 
plementation, and outcome assessment. The results of this 
investigation suggest that the following recommendations can 
help to ^ ng this about: 

I Three of the steps of the model, needs assessment, 
program planning, and pr>gram :mplcmen;atio'^, ,iould be 
the responsibility of the individual units after they have received 
anonentation to thepurposesand methodology appropriate for 
each. Checklists and written illustrations shoi^ld be pr .wid^d to 
assist '1 the task, (There will need to be careful considers on 
give') to the erention of an incentive to encourage units to 
cooperate J Completed checklists should be dc available to 
the UrTicc of Institutional Research or any on* -ffii.^ desig- 
nated Overall reponsibility 

2, Outcome assessment based upun specific program ob- 
je<^tlve^, if availablct and upon gerceral objectives if specifics 
an hot available, ^hoJ]d <^on;inue to be the responsibility of 
the Otftui of InstlEutionnt Rrjearch, 

3, The offline rcspimsib^c for program evaluation should 
present semi annual reports dircgtly to tlie deadcmii. units. 
These rcporb should offer spci^ifii^ suggestions to prog>cmi 
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heads regarding their offerii^s and should offer reeommcnda- 
tions regarding future use of the evaluation modeL 

4, The question of the flow of evattKition reports after Uiey 
leave theprogicjnarcas should be re^^lvcdand made explieit.Jt is 
clear that various academic administrators have legitimate uscb 
for all evaluation <fata The literature suggests^ however, ihat 
an evaltratlon. such as this one. designed for progmm impro\c 
ment, may lose the cooperation of ihose involved if it is 
perceived that the data may be used for other purposes. One 
way to lessen the likelihood of this occurring is to arrange for 
all reports to be within the eontrol of the individual acadcmie 
units /Accordingly, it is recommended that the semi-annual 
evaluation reports remain wEth program heads and that* once a 
year, program hcad!s be required to present iheir own summaries 
of the evaluation results to ihc appropriate aeadcmie adminis* 



trators. Thus, in thts procedure* the role of the oflfioc responsible 
for program evaluation would cease its presentation to the 
academie units, 

A final recommendation ib direeted toward evaluation 
prafesbionals them^lves. Namely, as> iheir uetivittes inerease 
in intensity* useful strategies will emerge whteh could be of 
benefit to their eolleagues around the eountry. The lime has 
come to share Ibcse experienees* both pleasant and not so 
pleasant, so that the literature may contain workable theories 
as well as sets of assumptions about how to do program 
evaluation. To do otherwise is toinviie repetitions of the hard* 
luck sagas bo many have faced. Evaluation is diHieult enough 
to do when arntcd with good tooUi without them it is virtually 
Impossible, 
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Background 

The topic of staff evaluation in Grant MacEwan Com- 
munity College^ is, f suspect, not much different from most 
other postsecondaiy educational institutions. Described brieHyt 
faculty are highly resistant lo any formal college-wide evalua- 
tion for (he usual reasons described in the growing collection 
of literature Administrators, as faculty arc quick to point out, 
tend to press for the Implementaiion of a faculty evaluation 
whiie they themselves avoid any consistent form of perform- 
ance appraisaJ. ^ 

In 1975, m; office was approached by an administrator 
who asked that wc conduct a formal evaluation of his perform- 
ance. This request provided i:^ with the opportunity of de- 
veloping and testing an administrative evaluation design which 
subsequently was carried out by twentyK>ne scnioi^ and middle* 
level administrators. The discussion which follows describes 
the design, tmplcmetitationt analy^iSt and follow-up procedures 
used In their evaluations. 

Purpose of the Evaluation 

As Scriven (1967) points out, many of (he suspicions artd 
misunderstandings of evaluation ^tem from a misinterpretation 
or lack of explication regarding (he difference between the rote 
and the goal of evaluation. The goal is always consistent to 
estimate the m^ritt worth, or value of whatever is being evalu- 
ated- The role (or purpose as it may be called) of evaluation 
can vary a great deaJ In performance evaluation, the informa- 
tion can be used by the cvaluatee purely for self-development 
or* on theotherend of the Continuum, can be used to determine 
whether a person should be retained in his or her present 
Capacity The role cf evaluation can serve many differem 
purposes. It is, however, important that participants under- 
stand and support the purposes of the evaluation. Since our 
evaluation procedure was admittedly experfmcnlal and because 
of, the thicat factor (which will be discussed later in more 
detail), it was decided that participants would determine at the 
onset of the excreise what would be the role or purpose of their 
own evaluations. Only if (he participants agreed would the 
evaluation be shown to their supervisors or anyone else. In 
fact, all those who look part, except the administrator who 
originally requested die cvaluationt chose to use the infocmation 
only for self -development purposes although many circulated 
thctr evaluation report among their staff. 

Phllo5ophy 

Any evaluation design is based on a set of assumptions 
which* Ihcinselvcs, rest on a particular philosphical point of 
view* In order to better understand the evaluation design 
discussed in this paper, the philosophical underpinnings and 
the postulates which aiv deduced from them can be slated as 
follows, 

Regardless of whether one does or does not ;;elicvc diat 
there should be evaluations of individual performances, all 
people are Judged or rated This is done, explicitly or implicidy, 
by individuals on themselves as well as by other persons, 
groups, or organizations who come in contact wltht or are 



affected l^y* their panicular performances. The standards or 
norms on which suchjudgmentsare mhde vary from individual 
to individual and from group to group, as does the quantity and 
qualhy of information on which the judgments are ultimately 
based and on which subsequent actions are taken. 

Since it is generally acknowledged that good decisions 
are a function of the quantity and quality of available informa- 
tion and since so many performances arc Judged on the basis of 
incomplcle and subjective information, it seems logical that 
evciyone should support attempts to broaden and make more 
objective the information base lipon which decisions are made. 

Basic Assumptions 

A number of basic assumptions arc mad^: 

1. The quality and utility of an evaluation is direedy 
related to the amount of objective, relevant information avail- 
able to the evaluators. 

2. Evaluation of administrators should be based on in- 
formation relating to the achievement of specific objectives 
through the performance of specificaUy delineated functions or 
activities. 

3. For each poshton, the functions or activities being 
performed are not of equal importance and must thcicfoic be 
ordered according to their relative significance in the overall 
context of the position. 

4. Information regarding the performance of each func- 
tion or activity should come from those sources most capable 
of providing firsthand observations of the evaluatccs or their 
wmk. 

5. Each information source is not of equal importance 
and must therefore be ordered in relationship to the overall 
quantity and quality of available jnfonnation. 

6. The relative weighting of each ir^formation souccc 
must take into consideration the amount of contact that has 
been made with the evaluatccs or their work. 

7. Effective evaluation must take place m an atmosphere 
of cooperation and trust between the evaluators and those 
being evaluated. 

Phases of Evaluation 

The cvaluatk)n at Grant MacEwan Community College 
was broken into three phases, the prcevaluation piiase. the 
evaluation process itself, and the posic valuation processes. 

Phase 1, Preevaluation: Gpals and procedures 
Goal I: To create an atmosphere of cooperation and 
trust between those being evaluated and the evaluators. 
Procedures: 

(a) Evalualees were provided with as much information 
about the evaluation as possible prior to the commence- 
ment of the activity. By oudining the assumptions unJcrlying 
the evaluation, the purpose ofthe exercise, the procedures, and 
finally the opportunities for self-dcvclopmcnt, much d the 
mystique of evaluation was dissipated and with it the threat. 
Explanations of the evaluation were provided to each partici- 
pant in writing and were followed by discussions in order lo 
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funhcr dorify the jA^umption^ anJ mcthoJolo^y. A pre- anJ 
posittc^t ^hovitfd thut ihe gmup ^ *i viholc felt more tumfurtablc 
jnJ iiupponive ^fter this proce^ than at the outset^ 

ib) As ^tatcJ previously, participants vierc allovicJ to 
JcxiJc the purpo:^ for vihkh their inJiviJual evalujttons vioulJ 
be UNCJ, By Jlovbing the nsks konseijiicnke3^ev4luation 
to be set b> each pcnron* the threatening nature of the pnxess 
was funher reduced, 

\c> Despite the fj^t thai oriI> t^ne paniutpant those to 
provtde his supervisor v^ith the evaluation informanon, a 
grievance procedure vvas c&tabLshed ^0 thai there }\oM be a 
ckarl> delineated means of appealing decisions made on the 
basis of such information, 

{A) Once the evaluation information compiled and 
analyzed, all raw data vierc destroyed so that no one could 
have access to the responses, 

(e> Follovb'Up procedures for staff development v^erc 
clearly stated, ff the purp^^M. of the evafuatton ^as to identify 
areas of administrative performance which required improve- 
ment* the institution should state explicitly the kinds of de 
velopmental activities it v^ould consider suitable and the degree 
to which these woufd be supponcd, 

Coai 2, To identify ami define as explicitly as possible 
the objectives of each administrative position and the functions 
or aaivities through which such objectives could ^e achieved. 

Typically* most job desenptlons arc both ambiguous and 
incomplete. There is a tendenc> to ascnbc similai objectives to 
various positions withtvut delineating the functions or activities 
by vbhich these objectives uan be met. In addition, since job 
descriptions arc usually at lea^t several years old, they may 
include functions which arc nu longer performed and omit 
others which have been impltciily made pan of the position. 

Procedures, The evaluator met with each administrator 
and carefully developed a job description svhich outlined the 
administrative position's responsibilities and general objec 
lives. The behaviorally defined functions ivere then identified 
whtchf in total, had to be adequately pcrfomied in order to 
xhieve the general objectives. 

While the development of such jOb descriptions sv^is, 
vtithout i^estion, the most diffictilt and time-conuiming poHion 
of the evaluation, it ts the author's vievt that the more exact the 
job dcscnpiion, the more accurate v^ill be the subsequent 
evaluation. 

Goal J: To identify [fie individuals and/or groups which 
can provide the tnaximum infonnation regarding tlie perform- 
ance of each func:ion. 

In the pastf many deviMons regarding the performance of 
individuals have been made using the intuiiive judgment of the 
supervisor or, at bcst^ relying on second' or third'hiiia 
interpretations of the evaluatcc s work or pcrfonnant:''. 

Procedures, Selection of information sources v <is based 
on the degree to v^hich these sources had direct cOnt,ict v^ith 
the evaluatees and/or their v^ork. Since each function could 
relate to a different group of individuals, both the evi>,uatee 
and his or her supervisor were asked lo independently 'lav^ up 
a ii\t identifying the most relevant sources for each tanction. 

Phase 2. The Evaluation process 

Step J, (nformaiion gathering: 

U> Identifying ihe relative imparlance of each function. 
After developing objectives and a functional profile of c^ch 
position the impoHance of each function in relation to the 
overall pos^ion was asce rial ncd. Since the evaluatee and htsor 
her jiupcrvisor vr^re best able to understand the objectives of 
the positioaand thca\tivitiesby v^hichthestccuuld be achieved, 
a form consisting of a defined list of functions and five point 
ratings scales v^ere completed by these two people. 



(b) Identifying the relative importance of each tnformation 
M^urce. As our assumptions state, each information source is 
not of equal imponance in assessing the performance of a 
panicular function. If, for example, two information sources 
are identified for a function, it may be that one of these sourees 
prx^vides the md^oi ponion of the required information, v^hik 
the other source provides additional information which is 
useful but relatively marginal. By assigning equal weights to 
both soufces, the accuracy of the information would be severely 
reduced. For the same reasons as stated in ''a'' the evaluatee 
and his or her supervisor were again selected as the persons 
most suitable to make such decisions, and a form similar to 
that described above was used, 

(c) Collecting respondents' ratings of performances. The 
instrument v^hich v^as used to obtain the assessment of per 
formances contained a list of those functions for which each 
information ^ouree had been identified. Again, each function 
was defined, and respondents were asked to rate the evaluatee's 
performance using a five-point scale ranging from ^upcn'or to 
inferior. In addition, space v^as provided for the respondents to 
write, in open-ended form, their reasons for selecting a 
panieular point on the scale. They were also asked not to 
rate the performance of any function for which they felt they 
had insuffieient information. 

Step 2. Organization and tabulation of data, 

(a) Relative imponance of each function, Fb' each func 
tton, an average (nuean) rating vias computed by adding the 
ratings of the evaluatee and supervisor together and dividing 
by tviO. If there was more than one person in a panicular job 
category, an average rating for all evaluatees in that position 
was Hrst obtained and then combined viith the supervisor's 
rating as desen'bed above. The resulting coefficient for each 
funetion was then used for wceightipg purposes. 

(b) Relative imponance of each infonnation source. Using 
the ,same procedure as outlined In ''a" above, information 
Source v^as substituted for fum.tion and weighting coefficient 
was derived for each information source, 

' (e) Respondents* ratings Of performance. Using the two 
weighting coefficients developed above and the performance 
rating data, tables were constructed for each position, 

(d) WriUen commentaries. The open-ended commentaries 
on performance provided by each information source were 
then compiled according to function and funher categorized as 
negative or posirive. 

Step J, Analysis of the data: 

Coal J : To identify any significant perceptual differences 
bcmeen e\aluatees and their supervisors rcgOfding the^l^ti\t 
importonte of the ^irious funttiims ivhidi make up *j p^irtituUtr 
position, 

ir for example^ the evaluatee perceives his or her m^r 
purpose as carrying out function A, a greater proportion of 
time and effon v^ill probably be spent in this area than, let us 
,say T on function B, Assuming there is some positive relation 
ship betsveen time/effon and effective nes5.» the performance 
rating of function A should be higher than that of function B If 
the latter function is perceived by the supervisor as being the 
primary function of the evaluatee, effective performance of 
funetion A wili not affect the supervisor's overall asses^^ment 
of the evatuatce's performance to the ex'ent expected by the 
evaluatee. In a more general sense, decisions resulting fioin an 
ccaluation based on tv^o dtfTering frames of reference v^ill not 
accurately reflect the effon ^r performance of the person being 
evaltiated, 

Procedures, The decision as i^j hat could be considered 
a significant d'tfTerence vias arb)traril> based un the total number 
of job functions for each administrative position,^ Significance 
of differences in ratings were established according to the 
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following cri I cria: (a) if wcne fifteen or less job funcilcns. 
a difference of one poini was viewe<I as signifieanl* (b) if 
ihfsc wert^ more than fifieen funelionSr a difference of iwc 
points was ecnsiclered iiignifieant. These erileria were based on 
ihe assumption that the fewer the number of funetionSf the 
more agreement there should be between raters. The number 
fifteen wa£ seleetcd by tnking Ihe midpoint of tlu; range of the 
number of job functions for aJI those being evaluated. 

Coal 2^ To provide a means of Identifying the rehiiive 
ejfeaiveness with whtcit evaluatees perform various fonLtions. 

Procedure' Utilizing respondents' ratings of perfoiman^e 
and the wcigluing faetor^ developed for each infonnatton 
<;ource, performance coefficients were calcidateU for e4!th func- 
tion using the following fonnula: 

'b+ ^ b + ...+ t)^ 

^s" ^ 

b 4- b' + - - . bj, 

Where: 

P " performance cocffieient 

K = a function 

R = ratings of performance 

M = maximum possible rating tintcs number of 

respondents 
s = infonnation source 
b = information source weighting factor 
n = number of input sources in series 

Ooid J, To provide a means of cofttpttrmg perpnnmces 
offuncttons and of positions as a whole from one evalmtee to 
another and for the same evaluatee over time. 

Procedure, Utilizing the perlbnnance coefficients for each 
function plus tlu;ir weighting factors* an evaluation cocHficient 
for each position was calculated using ilu; following foimula: 

P , y 4- P , , y' 4- P /y 
£ - \ ' \ ^ \n ^n 

y + y' + . , . 

Where; 

E = evaluation eocfficieni 
P ™ performance coefficient 
\ = a function 

y = weighting factor of function 
n = number of functions In series 



Coal 4, To provide a mmns of identifying the partiK ular 
persomd attributes whkh information sources have assoctattd 
with the poslthe and tiegative aspects of each evuluatee's 
performance. 

Procedure, All functions were first grouped into either 
management or adaptive functions,^ The former is defined as 
functions whi^h require effective and efficient coordination of 
human and nonhuman resources for the pttrpose of achieving 
stated objectives and which would include such activities as 
staff cooixli nation andsupervisiun, committee work* monitoring 
dcparlmenial operations* carryiag out adminisirativc assign- 
ments attd controlling departmental budgets. The latter ts 
defined as functions which address themselves to the growthof 
the administrative unit aad tlu; institution as a whole, TtK:se 
are fuacttons which require flexibility* adaptability and a sharing 
of information and ideas. Examples of such activiticsjaire.staff 
development* public relations, advising or consulting, short' 
and long-range planning, and research aad development. By 
identifying Xhft positive and negative portions of eaeh written 
comment and placing these in tl^ appropriate management or 
adaptive eategoiy* ^ overall profile of the evaluatee 's strengihs 
and weaknesses can be developed and related to the require- 
ments of the position, 

Phase 3, The Poste valuation process 

Coal I: To clarify for the evoluatee and his or her 
supervisor the relative Importance of each function In the 
o\erall coAtext of the position. 

Procedure: Utilizing the procedure outlined in phase 2, 
step 3, goal L differing perceptiors between evaluaiees and 
their supervisors ot the relative imp^^'tanee of various functions 
were identified. Where iltesc pcrcepiions were significantly 
differentia series of meetings was arranged by ilu; supervisor to 
discuss and clarify any misunderstandings. 

Goal 2: To develop a means of comparing administrative 
petformances both between positions and for the same position 
over time. 

Procedure: (a) Since for both the pcrfonnance aad evalu- 
ation cocffieienis tlu; possible range of scores is not 0.00 to 
1,00 but 0,20 to 1,00 (because a person lecciving the lowest 
score is receiving l/3thor20%of thchiglu;st score), tlw most 
appropriate way to interpret each coefficient is to express Uin 
terms of the pcfccntagc that a particular coefficient is of xhc 
total score. Figure 1 itlustratcs the relationship between the 
coefTicicnts atid the pcrecnta^ ^ ihai each Is of tlte whole. 
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The cocffiuent for the poMlion as j whole can be ubcj 4^ a 
bj!>i^ for uimpanng mjividual performances over time jnd 
alMj for comparing one evaluJtc^ agdtnst att othen>. I< thjs 
tatter U!)C ^^bicb mise man> haLkle^anJcnesofindi^nation. 
Let the aulhor» Uiercforc* expljin in more Jetait wh> he bcticvci^ 
b\Kh companions can bc vallJ. A summar> of the cvjlujtion 
coefficients for the twenty-one panjcipants shows the fullu;^ing. 

N: 21 

Range: 0.552-0.812 
M^n: 0.699 

Standard (deviation: 0.067 
Median: 0.682 

Figure 2 sho\\s the bell shaped diMribution of the&e ^rjlt^tion 
coefncients. 

Since the scores conform closely to the characteristics of a 
normal distribution (that a certain pcr^ntage of Ihe scores 
must fail between each standard deviation), a basis for establish- 
ing acceptable and unacceptable performance levels is provided 
Table I illustrateshowsuchagtoupinf could tx: developed for 
the 2 1 participants at MacBwan Community College. 

Table I 

A Group a( Evaluations Given Administrators 
at Grant MacBwan Community College 



Standard 


Number within 




deviation 


range 


Description 


+ 1 


8 


Acceptable 


"1 


8 


Acceptable 


+2 


2 


Ve[y acceptable 


"2 


2 


Margj [tally acceptable 


"3 


1 


Unacceptable 



BcvdUse the coeffictents arc admittedly a crude measurement* 
onl> those performances which fall v^ithin the -3 sUndard 
dcvidtiun might be constjerej seriously lackmg (urgently re 
quiring help and impruvenfient) and conversely* ihosc within 
the ^3 standard deviation nught be^considered as exixllent 
(almost beyond need for any further development). Sjnt:e the 
basis for such judgments is the conformity of an array to a 
nomial distribulion, it is only by comparing results across 
institutions and over time that wc will eventually obtain support 
or rejection for such an hypothesis. 

Goal 3: To provide information which can be used in 
impro^dng performances. 

Procedure: As could be expected^ certain weaknesses in 
performing various functions were identified in nearly all 
c4^. Priorities for individual development ;^en; established 
by examining ^d comparing the performance of functions 
coefficients. As would be expectedr high priority was gtven to 
the improvement of functions identtficd as most or very 
important and which had coefficients lower than the nonn. A 
close examination of the written comments usually identified 
areasof knowledge, skills, or atluudes which needed improve- 
ment, and appropriate development strategies were then worked 
out between the evaluatee and his or her supervisor. 

Phase 4. Pcste valuation workshop 

Following the distribution of evaluation reports to each 
participants a poste valuation woricshop was held. The objec- 
tives of this workshop were: (a) to obtain feedback from 
participants in order to improve subsequent evaluations* and 
(b) to identify the means and procedures by which evaluation 
information can best be used for administrative developnfient. 

Included in the workshop material was a questionnaire 
which asked participants the degree to which the evaluation 
helped them in developing a better understanding of the func- 
tions and duties of their positions and in identifying weak and 
strong areas of their performances. Participants were also 
asked whether they fell that an evaluation of thrs type should 
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be carried out on a regular basis and asked (hem (o describe 
any major disadvantages or advantages of this partieular evalu- 
ation pmcedure in terms of their own personal experiences. 
Responses to the questionnaire v/eie as follows: 

L Seventy-two % of respondents felt the evaluation was 
at least quite helpful in developing a better understanding of 
the funetions and duties of their positions, 

2 Ninety % of respondents felt the evaluation tVas at 
leafit quite helpful in identifying weak areas in their pef- 
fbnnances. 

3 Fifty % of respondents felt the evaluation was at least 
quite hclp^l in identifying strong areas of their pcdbrmaitces, 

4 Eighty-three % of respondents felt this type of evalua- 
tion should be carried out on a regular basis, 

3 Major disadvantages which were identified included 
these: ""A Jot of time is required completing the forms/* and 
"In some cases the process may have been used to get at a 
person rather than for providing feedbaek that would be of 
positive assistance/' 

6 Major advantages which were identified ineludcd these. 
'*Thc process makes you think of your job--what it is and 
what It should be/* **Peoplc were able to say things in writing 
that otherwise would have gone unsaid/' *'AiIowed me to zero 
in on weak points in my performanee/' ^^Givesan opportunity 
to look at perfonnance in a nonthreatening manner/* *'Providec 



others with an opportunity to look at my performanee in a 
byscematic manner and expreu opinionb in a confidential way;' ' 
and **lt is a eomfortabJe feeling to know that some p<^ple 
believe t am doing a reasonable job for the eollege and my 
department/* 

Discussions during the workshop centered around future 
uses of the evaluation, Jt was agreed that each participant 
would continue to detennine the purposes or mles of the 
evaluation. It was also decided thai participants would ask for 
an evaluation when they felt it was needed ratlyrr than have 
everyone evaluated at the same time. Those who wanted the 
evaluation used for salary and inerement purposes would pro- 
vide infofmation at the appropriate time. Others would de- 
tennine the time of their evaluation on the b«,^isof the amount 
of developmental activities they weie undertaking. 
Conclusions 

Partieipants in the Grant MacEwan administrators* evalu- 
ation generally seemed to approve of a systematie approaeh to 
evaluation. Surprisingly* few negative comments were received 
regarding the use of numerical eocffleients. Most participants 
seemed to rely heavily on the written comments and made the 
least use of their overall coeffieient. The coefficients of fune* 
tions were felt to be useful in identifying weaknesses and 
strengths. 



Footnotes 



'Gr^ini M;»cE!^^act Community Cott^g^. tiKatctl in Ectmonton. Albeiu, Canada, hjdbccn «ct op^Mlion stncc p*eM:ntl:> has an cflfollmcnt of apfiroitmaTCly 2400 

FTE*^ and a fult tin)e ^UfTof ttO facidty and 2S odmini^raioi^. 

sDtiririg I he pifoi telling stage^ boib raiik order cofrchtiom and ' t^ts were to idc]ilif> difff renews t^cttber proved icJiabIc a number ^asorii. 

'tnth^pifoiieu, ^\\ AM;c(t<M» wns t^gortroJasoncofrntfRj^^fflAif, W^^^^'J^^orfflaJitf^rtunt^^ (be iditer being dcHrKd a^ mcdiaimj^ bciv^nihc nods of ihc iikJLvJ<]ual 
and Ih^ (femaitds of tbc rof^ *' Tbis tnctudcf &pccifk adntinistrahwi jssjgnmenis C;ipect^ of Ibc jjidtvtdiML DtM;ussions iviUt admtnistriaioft mdicaied that nio&l 
maintcnoiKX activities a\ part of ibcJr managerial furKtions. For Ihis reason, Ibc iwo caiegoncs ^ttt collapsed inio orK 
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Before 1973* the concept of planning for the mosteffective 
utilization of faculty resources in higher education had not 
received prominent attention However, it \s estimated that 
since 1973 over 500 faculty development programs have been 
initialed in our nation's 2.792 colleges and universities. These 
faculty development programs take many foims. For example, 
the IDBA faculty development program at Kansas State empha- 
sizes giving instruetors course evaluation data. Gordon Cdlle^ 
has initiated individual growth contracts for its faculty. The 
Center for Instructional Development at Syracuse University 
focuses on improved methods of instruction. Other colleges 
send faculty to workshops on faculty development or they 
indhuie facuNy development workshops within their own insti- 
tutions The College of the Rnger Lakes has active in this 
respect* 

The current interest in faculty development has oceuncd 
primarily for the following reasons; 

I , Decreased mi)blHty for faculty— Because there are more 
college professors qualified for positions than there are posi- 
tions available, professors are experiencing fewer opportunities 
to move from one institution to another. As a results in order lo 
plan for a change, educational leaders within institutions are 
beginning to consider how best to ensure that faculty members 
engage in self-renewal so that they can actively contribute tothe 
goals and.Pbjc^tives of their institutions, 

2 Pressures for accoumabUtty — As a result of tight bud- 
gets for higher edircation throughout the country, state legisla- 
tures, boards of trustees^ and the multiple publics served by 
higher education are beginning to demand that institutions 
aaively denwnstrate that their facuhy are responsive to the 
needs of the institution and to the needs of the students, Faeuhy 
development efforts are a visible way to accomplish this* 

3 Accent on student /e^i»'«i«^— While people at many 
levels are demanding accountability, one of the main thrusts has 
been aeoountability for student learning. Cross (1975) views 
'*aeceni on student learning*" to be the phrase of the 70s in 
higher education. In the 50s the theme was accent on selection; 
in the 6Qs the theme was accent on access, 

4 Research on faculty members— ^lnQC I960, higher 
education has increasingly become a legitimate academic area 
ofsti;dyVithln colleges of education. As a result, the data base 
about facu I ty>n embers in higher education is constantly e\ 
panding A m^orlbcu^^f this rcseareh is concerned with how 
faculty members grow and develop in their professional roles. 

5 Concerns for integrating theindividual and the organi- 
zation — fnasmueh as cunent management literature hascmpha* 
sized the necessity for integrating the necds'of the individual 
and the organization, there has been an increased concern for 
such integration McGregor* Argyris, Bennis, and Likert are 
among those who have helped educational leaders conceptualize 
the need for this complex integratk>n. 

The number of writers who have begun to contribute to the 
information base about faculty development has grown steadily 
in the last five years Simterly (1973) is anwng those who have 
studied various dimensions of faculty growth and development. 



(Diagram 1 shows his 1977 conceptualization of thecomponent 
parts of a faculty person's roles,) Simerly contends that it is 
essential to consider these dimensions when viewing the com- 
plex interaction between faculty members and the academic 
organizations in which they work. 

The research design presented in this paper expands on 
Simerly's initial study and also investigates the process com- 
ponents of the personal, professional. ,ind organizational di- 
mensions of faculty members' roles. The purpose of the cunent 
study is to gain new insights intothe factors that contnbute to or 
stand in the wa> of the professional growth and developmentof 
academicians, li is anticipated that an improved understanding 
of the interaction between professional faculty members and 
universities will be helpful to institutional researchers, adminis- 
trators, and faculty members who are interested in designing 
environments that lead to the maximization of all institutional 
resources — especially faculty members. 

Using a large, private university in the Northeast with 
approximately 16,000 students and 300 faculty members, a 
random sample of 5 percent of the faculty, stratified by the 
ranks of assistant, associate, and full professor, was selected. 
Interviews were held with 39 professors for the purpose of 
gathering data about their perceptions of vanous aspects of their 
professional growth and development, A structured interview 
schedule consisting of 42 questfons was buih around seven sets 
of constructs which relate to organizations. These constructs 
were viewed to be particularly relevant in studying the process 
components of faeuhy members' roles. The seven sets of 
constructs included the works of Maslow (1954).^ Porter 
(1961). Carpenter and Strawser(l97l), ^rgyns<1957). Lewin 
(1947). Herzberg. Mausner, $l Snydennan(]959), and Gould- 
ner (1957 & I95S), In addition to these constructs, research 
about faculty development which was completed by Simerly 
(I973)t Gaff and Wilson (1975), and Bergquist and Philhps 
(1975) also provided guidelines for procuring importa;it data. 

Individual Needs 

Twelve interviewquestioRs were based on Maslow*s(l^^4) 
hierarchy of individual needs which posits that the destre to 
satisfy basic needs is the prime motivating force underlying 
iF^d'ivtdual bchavtorSi This conceptual framework has been 
tested in numerous organizations, Maslow contends thai people 
seek to fulfill their needs in ^ hicnirchjeal fashion— physiological, 
security, social, esteem, and sclf^tualization — and that a 
higher level need will serve as a n^otivator only after a lower 
level need has been reasonably well niKt, 

Porter (1961) has devised instrumentation for measuring 
the present level of basic need fulfillment as well as the desired 
level of need satisfaetioni Although Porter has applied this 
instrumentation to numerous organizational settings, few re- 
searchers have used it in the field of education. Trusty and 
Scrgiovanni (1971) have applied this instnimtent to public 
school personnel. Carpenter and Strawser 1 197 U have adminis- 
tered a modiHcd Corm to accounting professors- While Porter's 
instrument difft;renttates between the cxtding and desired levels 



.89 J 7^ 



ASSESSING FACULTY GROWTH 



Dimensions of 
faculty devetopment 


ConcefHual 
components 


Process 
component 


Personal 


Adult life stages 


Human motivation 
Individual gtowh 

Adaptabiliiy 
Attitudes 


Pmfct^ional 


r 

Curcerpath 


Tenttie- promotion 
SocialrzaTton to role 
Local-cosmopolttan 

reward orientations 
Mobility wiihin 

profes^ton 


Org^inizaticna] 


CoUege and university 
cnviionmcni 


Oigamzaiional 

mobility 
Aflapiive tectiniques 
Real and pcrcetved 

reward s^tems 
Organizational 

conflict manage^ 

ment 
Curriculttm reform 



Diagram 1 . Cotnponents of an over-aJI concept of faculty 
development. 

of basic need fulfillmcnl to determine a "'need s^sfaclion"" 
scoic^ Carpenter and Straw$er label this needs differentiation as 
a measure of *'need dUcrcpanctes/' 

A portion of the research described in this paper also 
focuses on need discrepancies. Diagram 2 illustrates the dis- 
crepancy scores that were derived from the members of the 
sample for each need category. A low score showsthat there is 
Jittle discrepancy belu^^cn the cxbting level of need fulfillment 
and the desired level of satisfaction. The assumption then is 
made that a larger discrepancy -score represents a sinaller degree 
of salififaction for that basic n:ed category, (p. 513). 

Ourstudy reveals that faculty have the lowest discrepancy 
ixore C3> and thus the greatest satisfaction with their work -in 
the cfieem category. This includes ihe amount of prestige and 
regard professors think they receive from thetr employing 
organization as well as what they receive from their profession 
at large* The largest discrepancy score (.7)t and thus the least 
satisfaction with their work, occurs in the autonon^ category 
with the social and self-actualizing categories revealing dis- 
crepancy scores that are almost as high (.6). 

Even though we see lower and higher discrepancy scores 
between existing levels of need fulfillment anddesired levclsof 
need sausfactiont the verbal comments from the m^ority of 
professors in our sample indicate that their individual needs are 
generally satisfied 

Typical of the comments made by the faculty members in 
our study about ncc<l fulfillment is the following: 

I think I have done the right thing in life. I'am in the 
right place; I stand sufficiently rewarded for I have 
done. I have no ahcmatjves in mind. In other words* 1 
am doing exacdy what I should be doing, and the daily 
frustrations or other things are just part of life. I feel if I 
die tomorrow my last comment will be, "Yes, I led a 
satisfactory life as far as my professional life is con- 
ccmcd/' 1 wanted it that way, and I wish everyone 
could be that happy. Even if i dOn't know if my 
contribution is that grcatt 1 still won't be frustrated— I 
am too old for that. 

Organisational Goab 

Three interview questions were developed around A^e>ris* 



(1957) theory of the incompatibility between individual needs 
and organizational goals. JLrgyns.belicvcs.thatitJs,ab$oJutely .. 
essential for the inevitable conflict between the needs of the 
individual and the demands of Ihe organization to be acknow- 
ledged* discussed^ and managed. He says that an effective 
organization is one that achieves goals* maintains itself intern- 
ally* and adapts to its environment. 

The data from our research reveal that the faculty members 
in the sample understand their departmental goals and objectives 
very well, but their satisfaction with these goals and objectives 
is only average. Fortunately* they seem concemed aE>out the 
situation and express considerable interest in altering these 
goals and objectives. Specifically* assistant professors report 
the most satisfaction with the gpals and objectives* yet they 
express the greatest interest in changing them. Associate pro- 
fessors* on the olBer handt indicate less satisfaction with the 
goats and objectives and, as a group* arc the least interested in 
altering them^ while full professors show the leasi satisfaction 
but aie more interested in change. 

These data imply that there is a willingness on the pan of 
faculty-to examine their departmental goals and objectives and 
to woi^ for change where necessary. Such a re*exanunation or 
alteration might very well reduce the incompatibility between 
individual needs and departmental goals for this group of 
university professors. It is also important to note* however* that 
one of the things faculty understand is that gpalsaieoften vague 
and not expressed. " 

Typical of the comments about departmental goals and 
objectives made by members of our sample is the following: 

"I think I understand that they are very poorly defined at 
best* but I understand that pretty well."' 

Teachingf Research, and Service 

Nine interview questions were developed from field an- 
alysis theory hy Lewin (1947) aiwlYaculty development reseaic\ 
by Sjmerly<1973) and Gaff and Wilsi0n(1975).Lewin's theory 
posits that change is the result of an imbalance between two sets 
of opposing forces— dri ving forces that push for change and 
restraining forces that discourage change. He also contends that 
patterns of human behavior areincopstantdynamicequtlibnum 
and that it is crucial to analyze/ the forces that work on 
individuals at a particular point in time in order to learn where 
change* such as a faculty development program* might be 
introduced. 

Gaff and Wilson surveyed 1 ,000 professors about various 
aspects of faculty development andconcluded that mo^t faculty 
do not Ihink that teaching is regarded as important in their 
respective organizations. Neither do they think that good teach- 
ing performance is rewarded. Tlicy also identify faculty de- 
velopment programs as a viable vehicle for raising faculty 
consciousness about 4eachtngt expanding knowlcdgcof altema- 
tivc teaching technologies* and- increasing teaching skills. 
StmcrJy*s research confirms this. 

Our findings support the results of the Gaff-Wilson study 
and Simcrly's earlier research. Over half of the professors in the 
prescntttudy believe thai teaching comprises the major focus of 
their professional activity, [n additiont they think that teaching- 
related activities contribute the most to their professional de- 
velopment However, they do not think thai teaching and 
working with students is as likely to result in tenure and 
promotion a* is research that leads to publication. 

When asked about t'ic type of ^^upport provided for teaching, 
research* and service, a majority of responses referred to items 
like funds, rcsourccst and fkici 1 it ics— items that Heizbetgt 
Mausncr & Snydcmian (1959) would undoubtedly eatcgoiizc 
as hygiene factors because they tend to satisfy the Jowcr-ordcr 
needson Maslow's htcrarth^ . On the other hand, professors see 
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Diagram 2. Discrepancy scores derived fram the members of the sample for each t eed category. 
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considerably less support in termc . couragemcnt, freedom, 
promotion and [cnurc -items that ^..rzberg vvould refer to 
."lottvatfon factors or s^tisHers of the higher order need^ on 
Maslovv's hierarchy Our data clearl) jmpt> that the unlveTbU> 
doe: a better job of helping its facult) members to avoid 
dissat' -tion than it docs of helping to achieve ^atiii faction. 

Vllen asked about the aspects of the working ervitonment 
h general that promote professional gtowih and develops m* 
again Over half of the responses from our Sample referred to 
hygiene factors such as the library, other physical facilities, 
leaves of absence, research funds, and suppon personnel. 
Mo[^ than one-Iourth o^ the comments mentioned humdni 
fac[ors such as .v 'ents and coltea^es^ and the remaining 
remarks referted u .notivation factors lik^ a positive urjver&ity 
attitude^ individual auconomy, and personal ir^ttvation. The 
data from Sim^rly^ study revealed basic<i11y the same results. 

These dita cc istitute a two-sidcd coin^ hovvever. White 
the abo^ v mentioned factors onr believed to promote profes- 
sional g4^A\th aiJ development, the .^ence of such faetor^ Is 
perceived hinder growth and development. For exan^ple, 
lack of psychological support from the university, ^xk of 
personal motivhilon, and work overload were ment oned in 
half of our responses as blocking growth and development. 
Such things os inadequate facilities and lack of ^\ ney for 
research^ trav!, secretaries^ and graduate assistan'.s were cited 
as a hinderance in more than one-fourth of the comments. Lack 
of colleagiality was discussed zs a hindering factor in the 
remainder of the responses. 

Faculty members are veiy conscioiis of the drivit 
restraining forces that arfect their growth and development in 
teachings research, andservice^ Typical of the comments made 
aboi:t these three area^ of the promotk)n and tenure system is 
the following: 

In tf> ns of encoumgeme.. . 'alk is cheap. There is a lot 
of utcourageiT'^nt for teacning. When it gets down to 
money and promotion^ it*s not quite so high as far as 
teaching (fees. In terms of research, there's a lot of 
encouragement for research and publication. It*s pri- 
marily pitmiot^on and tenure but also the availability of 
research fuitUs and applying for grants. So tite university 
docs givt^a lo? of suppon. There issomearknowledge- 
inefit On the basfj of debates in faculty meetifigs about 
the ambivalence about service to the university. ODv 
segment thinks that service to the department, to the 
university, is veiy important; others say it*5 not so 
important and let's not put too much emphasis on it. 

Reward Systems 

Nifte interview questions investigated various dimensions 
of the reward system. These questions were developed from 
Levvtn's theoiy of r1eld analysis as weJI as from Gouldner's 
(19*'') locat/cosmOpolitan theoiy of rewards. Oi uldner views 
''cosTriOfolitans'' as individuals whose commitment is es- 
sentially to ihe p.'jfession at laige and "locah" as those who 
exhibit primary loyalty to the organization. 

The professors in our sample report thst they have a 
below average satisfaction with their monetary rewards. Hcu^ 
ever they have an above-average satisfaction with other rewards 
such OS academic and personal freedom; tuition for spouses 
and children^ insurance, retirement benefits^ travel allowances; 
inte^-^ction with stu<^ent5 and colleagues; recognition , prestige, 
regard, and the promotion :jid tenure possibilities. There is 
one notable exception to this genciBl trend, however A ^"iate 
professors reported the least satbfaerion with the reward system 
and indicated ihat'thcy believe the overall niversity rev,ar<) 
structure hinders their growth and 6rx ^iment more than it 
helps. 



In genera], the faculty nfiembers baid they vvould like to 
!>ee d gieater clarification of the revvard ^y^tem that vvould 
provide for more flexibility and allovv for greater empha^ki^ to 
be placed on teaching and ^^orking vvtth ^tudent^. In additjon, 
they vvould like greater psychological support from the univer- 
sity in tem^s of recognition, jpprectation^ and greater inlcrtjt 
in them as faculty members. 

Almost half of the profesbor^ in this study think that they 
acquire their re^^ard^ equally from the university and from the 
profebbiott at large. Over one-fouuh of the professors believe 
that moi. of their rev^ards come from jutsjJe the univer&ity> 
vvhile the remaining one-fourth of the professors thtnk that the 
majority of their rewards come from inside (he university. As 
Hiight be expected, full and a&sociate prolcbsors are more 
likely to vievr tlieir profession as the m^yor source of revvards 
than are their junior-level colleagues. Three-fourths of «ie 
faculty members envision outskle rewards to consist of tangible 
activities like lecturing or speaking at conferences* conven[ions> 
and seminars^ or wrtting books* articles, and other publieatjons, 
A few talk ibout consulting jobs such as working for the 
Public Emplo,vment Relations Boards setting l^. ^^s in foreign 
countries* or lefeix^eing papers foi jobiiials, S include 
personal accomplishments like exhibits, performances^ private 
practices, and resi^arch grants as a source of tangible outside 
re^^ards. Only one-fourth of the comments about outside re- 
vvards refer to intangible factors that have a common thread of 
recognition, prestige^ and regard, , 

1, teal of the comments that faculty members made 
about the rewcj'ds system is the following: 

[ Ijke the fr&'^dom [ have to choose my hours — to work 
vvhen 1 want to work and to do what I want to do, I have 
pretty good leeway on that. I can't teach at 3 -in the 
morning, but I can work at 3 in the morning, It*s also 
personal frecdom^I can dress like this and wear sloppy 
pants and Beethoven shirts and do what I want to do, [f 
they don't like it th*^ worsi if , *Kcy can do is not 
promote me, and that s not the v thing in the woi'ld 
either. If I was very straight* being nice to people even 
when I didn't like them, I'd get p^mo^i earlier and 
have bigger salary increases, but Acn th^^t's margin,,!. 
It's not like the business world where if you don't do 
that you're out — goodbyl 
Thus, the things that faculty members tend to like most 
about th' reward system are the tilings that co^v ibute to their 
autonomy, their fringe benefits, and their i, traction with 
^ople. The things that faculty members like least about the 
reward system are inisdequate salaries and other tangible items 
such as inadequate services and physical facilities,' 

Teaching Changes 

Five jnterv w questions were based on a ponion of 
Simerly's (1973) research that identified various aspects of 
professional growth and development resulting from teaching 
changes made by professors at a state university in the South, 
Simerly found that the major change was an alteration in 
teaching methodology that de-emphasized the lecture method. 
This, change was generally triggered by interaction with col- 
leagues^ and feedback from informal student evaluations. 

The PL :f£^ni research also reveals that the majority of 
changes jr teaching were in the methodological area, Th 
included the vt^y information was delivered, the jse of dif- 
ferent materials, and the individualization of instruction. Other 
changes in teaching rcfened to alterations in course content or 
the curriculum. An overwhelming majonty of the professors 
felt that the chail^cs they had made in their teaching resulted in a 
positives impact on them as well as on their students. 

People were cited most frequen<ly as the change agents^ 
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and these people ineludeJ the professors ihcmselves as as 
their peers, siuclents, and department ehairpcfaotis. New hori- 
zons in the proression and "Sceeping up with the tin^^^;*' were 
mentioned as Taclors that were responsible for ehange. The 
faculty members evaluated iheir ehanges both formally and 
infonnally wiih more responses alluding to informal judgments 
derived from student comments* colleague feedbaek, student 
productmty, and personal polltleal prowess. A eonsiderable 
number of responses* however, reflected the use of fon^al 
evaluation practtoes like questionnaires, exani scores, an<l 
expedment.il research to ascertain th^ value of their leaching 
changes. 

These data show that changes in the teaching process arc 
viewed to bc more importan' th^ changes in course coatent, 
and such process changes come about largely because of other 
people Faculty members place a positive value on these 
changes ant' arc ^tempting to evaluate the eCTccts of thcjr 
change efforts. 

Typical of the comments that professors made about 
changes in their teaching is the following: 

The desire for promotion was not unimportant In making 
the ehange \u my teaching That*s carrying a st . over 
you and it is of some consequence. Also crxjc in the 
promotion paw is the student in\.i 'Unfortunately, 
students who get along with you are not verbose about 
it The correct sttntegy for getting promoted as soon as 
possible is not to rock the boat — don^^t nfiake waves, 
uonH take risks, don't do new things. Whc ;evcr I do 
new things, those who like it shut up, but (hose who 
hate it say so f decided not to fight the batt* s any 
more Til get promoted and then maybe go back to my 
old way of teachi"*^. 

Faculty Dcvelopnfienf 

The last four questions on the interview schedule were 
based on Bergquist and Phtllipir' (1975) work and a portion of 
Simerly's (1973) study. B^gquist and Phillip^ eontend lhat 
faculty development tan be accomplished through a compre- 
hensive program *vhk:h includes development in the persona., 
instructional* and organizational dimensions. Simerl^ ^fuggests 
that faculty development should be a continuous, ongoing 
program focusing on the process of faculty development rather 
than on specific content* 

The results of the present research reveal that 87 percent 
of the professoi^ report no faculty development program in 
their department, 10 percent are not sure whether they have 
one or not, and 3 percent say that there is a program in the 
<lepartimnt Only twOj>rofcssor5 expresses* total lack of interest 
in taeulty dcvefopment ac;iv<tic^ — one w^s ncaring retirement 
and the other had Just learned that his program was being 
el uinated Simcrly aUo reported that the majority of professors 
in h'lS study said that there v/as no faculty development program 
at their inbiitutron However, he found somewhat less interest 
in a planned program — only 26 pcrcer* of the sample were 
interc::ted in having faculty development, 52 percent \vere 
unstire> ard 12 percent did not want one. 

While the professors in the present study rated their 
interest in faculty development very high, it is interesting to 
note that the assistant piOfcssors reported the greatest amount 
of interest, followeti by associate and full professors respectively. 

When aske<l to identify the people who should be re- 
sponstble for initiating a faculty development program, 54 
percent of the respondents mentioned the departmental chair- 
person with some help from fhe faculty. Thirty-three percent 
of the professors thought that the faculty themselves should be 
the initiators, and IQpercent of the sample saw it as the dean's 
job Only 3 percent of the professors felt that professional 



growih and development should be an individual responsibility 
and that there was ao need for a planned program. 

The prof'"^ j s in this study discussed nurT,*;rous aspects 
of a planncu faculty development program, but nearly three- 
fourths of their responses expressed interest in increased sharing 
with colleagues, more encoi»r::5OT^nt from the university, and 
greaier assistance for irT^,proving instruction. One-fourth of ihe 
comments indicated a desire for improved ft nanetal* assistance 
and relief time, Simerly*s data revealed approximately one- 
fourth of thi, sample not knowing what to include in a faculty 
development program, one-fourth requesting sabbaticals and 
conventions, one-eighdt concemcf with individualized pro- 
grams, and the remainifer ^vanting assistance with their teaching. 

Analysis of the data from the present study clearly indicates 
that faculty members see a real need for assistance in becoming 
more effective and efficient in the tasks they encounier as 
facu*;y members. They, have some definite ideas aboui whc? 
should take the lead and what a program should include, ^nd 
they ar. adamant about designing a flexible program that deals 
vvith individual c6ncems rather than a rtgid one that forces 
everyone into the same moi Ivlany professors offered their 
help in oJanning any faculty development program that would 
help 1 become better at what they do. 

Typical of th(* comments that these professors made about 
iaculty development is the following: 

If Industrie:* have development programs why not uni- 
versities? One of the members of our department who 
has b^n here for 20 years gets negative feedbaek on his 
teaching. lt*s too bad. Rather than lamenting about it, 
why isn't someone working with him review his 
teaching and perhaps helping him to improve? Af^er all. 
we recognize he'll probably be around for anotlier 20 
years. That would be part of a development progratn 
and there is no reason why experts can't be brought in or 
otherwise secured so as tt fK*lp people improve in all 
areas. 

Conclusions and Implications 

In summary, our study reveals the following Information 
about the m^ority of the faculty members: 

1. They arc generally satisfied with the overall fulfill- 
ment of their individual rieeds. Specifically, they expenenee 
most satisfaction in the area of esteem needs and the least 
s, ^ V^'ietion in the area of autonomy needs. In additioni self- 
aMa£tization and social needs provide less satisfaction than 
security needs. 

2. They understand the goals and ot^eetivcs of their 
departments very well, but they have Only an average amount 
of satisfaction with them. Frequently, ithey find th^" goals and 
objectives to be vague or poorly ar iculated, but they are 
interested in working to change the si nation. 

3. They view teachi^^g activities ^ the source of eentral 
activity and satisfaction in their profe: sional lives. However, 
they do not believe that quality teac ung is instrumental m 
gaining their tenure and promotion. , 

4. They believe that the univetsny does a better job of 
helping th^^m to avoid dissatisfaction than it docs in helping 
them to achieve satisfaction. More prccisely, the university 
tends to provide support for their concietc, lower-order needs 
and not supply it for their psychological, higher^order needs. 

5. They arc not cry sa sfied with the monetary rewards 
they receive from the university, but they tend to be satisfied 
with the other tangible rewards and the psychological rewards 
that are provided. In genetali they would like to see more 
clarity and greater flexibility within the reward systcnr.. 

6. They have made the most changes in their teaehmg by 
altering their methodology so that information is delivered in a 
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vdiiot) of vtsjb. Overall, thuy arc pleasc4 mth the changes 
thc> have maJe anJ believe that their stu^nts arc too. tt 
interesting to note that most professors attempt m some vtdy to 
evaluate the success or failurc of their h^hing changes. 

7. The> report thdt practKall> none of their departments 
provjJc planted faculty ikvelopmcnt programs. Hovtever, the> 
are vei^ Jntere^ted Jn suvh programs and express a vrdlmjgness 
to p^*^icipate in them. Most profes^rs believe that the depart 
mer.t chairperson should be responsible for initiating a fakult> 
iievelopment program, and the> ait adai.^t about mjjntaming 
flexibility to accommodate individual concerns. 

Our st>id> has several implications for jnstitutional rc- 
searchers \^ho are often asked to provide information about 
fjcult> to mstitutional polic> maken>. Although a number of 
coit. .eri^cd wa>s for reporting faculty load have been dev. seU, 
little has been done to deveVjp procedures for rcporting other 
kinds of information about faculty. While faculty load daita 
certainly ate very necc^viry j they are far from suffjcjent for the 
. p'ver^ity that Is a>nkemed vtith the best utilization of one of 
Its largest human resources — the faculty. 

According to Warden (1974), institutional research has 
been ve."^ limited in the past and haii had little, jf any, jmpact 
jn unit planning and virtudly no j.-npa^t on faculty improve 
ment. fn addltjon, jnstituttonjl resednjiers aie frequently viewed 
as the enemy because they are an extension of central admints 
tration, and as a ce:sult they tend to be isolated from academic 
goals and faculty Concerns. 

Warden is alMi among those vtho speak about the need for 
expanding institutional research. She says that "any method 
used to gather data on faculty activity should permit analysis 



of a \^ide range of activity categories and related intended 
outcomes'* (p. 463). It is our contention that an imponant 
dimension of this vtide range of institutional rcsearch a^tjvjty 
is the inclusion oi' laculty concerns about their professional 
gro^^th and devdoptnent. Not only should therc be a vehicle, 
such a^ the one described in thjs paper, for gathennr and 
reporting thjs information, but this valuable . art of mstjtuttonal 
researci should be fed back to faculty members thrjniyclves. 

[n addition to increasing the \^onh of tlie ^iristitutionai 
researcher's data bank, such faculty centered rcsearch \^oujd 
undoiibte4ly result in a number of other verv positive outcomes. 
Warden <p. 471/ suggests that faculty would probaoly become 
more productive as a result of being in the e\pehmental 
spotlight (the Mav^th^me effect^ and that faculty attitudes 
toward central administration vtould be likely to improve be 
cause institutional researchers would no longer be vje\^cd as 
the "bad people. Also, faculty members might start to \KVt 
reallocated pnontjes and Lmited resources as a challenge to 
their ingenuity rather than a^ a barrier to ih*i execution of their 
work. 

We believe that this nevt dimensroi. of in£!*t*.monal research 
would lead to a better integration of individual needs and 
organizational goals ^ ^ell as an improved conelation between 
reward systems and desjred outcomes. Faculty members would 
have greater incentive and more support to change, grow , and 
develop in their various loles. 

Certainly universities can profit a grc^i deal if institutional 
researchers begin to seek informalion that allows them to 
analyze what might happen in addition to. data that permits 
them to justify what already exists. 
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AN EXAMINATION OF THE USES OF FIVE 
MEASURES IN DETERMINING FACULTY 
WORK LOAD 



Ralph E, Henard 
The University of Colorado at Den 



The problems for postsecon ary institutions, in allocating 
faculty resou,*<»3 and in providing supportive data for budget 
requests for additional faculty, will become more acute as 
institutional and state budgets tighten and as student enroJi- 
ments decline TKcse conditions wilt increase the importance 
of mcasunng faculty work load^ 

The following five measures fbf detennining faculty work 
load wilt be cOmparcd^ (t) course credit hours taughtt (2) 
student credit hours produced, <crtdit hours x number of 
students; calculate<l for each course)* (3) class Contact hours of 
facutty members, (4) and (5) faculty work toad formulas of 
institutions that use adjustment factors to equate the teachJr\g 
loads for different types of academic activity: lectures, labs* 
theses, etc. 

The problem in using course credit hours taught, contact 
hours, or student credit hours <SCH> generated as measures of 
faculty work load is illustrated ^y viewing Figures J , 2, and 3 
showing the variances in these measures of work load for 
faculty members or the College of Engineering at The University 
of Colorado at Denver How does faculty member J rank in 
the College of Engineering telated to his or her proportions of 
the college totals'^ He or she is eighth in the number of eiedit 
^Ours taught (Figure 1), tied for second on contact hours 
(Figure 2), and third in SCH generated (Figure 3). In compari- 
son, faculty mcmt>er number 7 ranks ftrst in credit hours 



taughc, ftrst in contact iiOurs, and ninth in student credit hours 
gen^'-raicd. 

The findings f'- faculty members J and 7 reveal the incon- 
sistencies that occur when any one of ttte above measures xs used 
to C0mp4re the work toads of faculty nfiembetstnasinglc depart- 
ment, ff student credit hnurs were used as the only nfieasure^ 
faculty member I would show a heavier work toad than faculty 
memt>er 7, On the other hand, if contact hours or credit hours 
were the single measure* number 7 would have the heavier 
work load. 

The problem of comparing faculty work loads usirig credit 
hours, contact hours* or SCH becomes more complicated when 
two or more departments, disciplines or schools colleges are 
invnJvcd, Forexamplct facutty member number I in education 
!jas 5,5 more contact hours than faculty member number 1 m 
engineering. Faculty nfiember J in education also has 379 more 
student credit hours generated and 17,5 more credit hours 
taught. Because tite School of Education has a larger graduate 
program than t^■e College of Engineering, the proportion of 
thesis* independent study* as well as practicum credit hours and 
student credit hours Is much greater thikii ^or engineering. 
Thus, it ib possible for education faculty members to show 
higher numbers of credit hours taught and student credit hours 
generated than is the case for engineering faculty numbers. 

The variances in the proportl'^ i^ of the discipline work 
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Figure I Graph for The University of Colorado at Denver bhowing the percent of total credit hours m engineering 
taught by each faculty member. 
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engineering for each faculty member. 
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Figure 3. Graph for The Univer!kit> of Colorado at Denver showing the pcaent of toul ^^tudent vrcJa hours pruduved in 
engineering by each faculty member. 



load Lamed b> individbdl faLult> members vvere, alM}, the 
vdsc for chcmi^tr>, evjnomics, and English. Hovvevcr, the 
variances were not a^ gieat m economics and Cnghsh a^ the> 
vvcre in chemisto bcxaus^ the biter has mme vaned instructional 
activities. 

The development of Formulas to 
DetermEne Faculty Work Load 

Because the proportion of the total discipline or dci^art 
tnent work load for a ungle faeulty nicmbcr varies gn!atl> 
when credit hours* contact hours* or student credit hours arc 
used as measureii* and because there ma> be an even greater 
variance in comparing rhe work load of tvvo facdlt> nicmbcr^ 
in different disciplines or departments, there has been 4n 
attempt iy> develop nork load formulas that provide adjustment 
factors vvhich vvetght different t>pc& of instructional activit> 



(lecture , labs, etc. J and the levels (undergraduate, graduate; on 
which the> occur. The adjustment factors are maltipbed b> the 
basic unit for a given insLiictional activit>. For example, an 
undergraduate lecture course ma> have an adjustment factor of 
1 .0 while a gtnduate lecture course may have an adjustment 
factor of 1.5. The adjustiuent factors are multiplied by the 
credit hours of cbe course* thus a three-hour undergraduate 
course would produce three unfis of faeuify work load (3 credit 
hours ^ I'D adjustment factor)* uhile^a three-hour graduate 
course would produce 4,5 worK load unils (3 x 1.5), 

Table I compares the adjustment factors that have been 
developed b> two universities des]£;n4ted as unjversit> I and 
untversit> 2. An exammatton of the adjustment f<^vtors and the 
basic units shows that each institution uses the same ones for 
undergraduate and graduate Icvturc coun>cs. The adjustment 
factors differ greatl> for d\ <^ther instructional 4ctiv1t.es. The 
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Tabic J 

Comparisons of University One and University Two Basic Units 
and Adjustment Factors Related to Instructional Activity 





University 1 


University 2 




Instructional activity 




AHikKtm^nr 




Adjustnnent 


(Numbers rn parentheses = class code) 


H-^Cirt it nil' 

pdSic unii 


fflctor 


Basic unit 


factor 


Undergraduate lecture (5) 


Credit hours 


1.0* 


Credit hours 


1.0 


Repeai scatons/undcrgraduat^ tecture 


Credit hours 


.75' 




— 


Grsduaie courses (5) lecture 


Cnsdit hours 


L5* ' 


Credit hours 




HoTwrs sections/cotloquia 


Credit hours 


1.5* 


— 


— 


Repeat «cctionS/giaduate or boiwrs 


Credii hours 


M25' 


— 


— 


Reciraiions (6) 


Cretfit hours 


.75' 


300 students 


.003 








400 students 


.0025 


Senninars 


Credir hours 


.75* 


Credit hours 










UnderB/^uate 


I-O 








Gradual 


1.5 


Aaiviiy classes, clinics 


Contaci hours 


.33* 


Credit hums 


1.3 








(Contact: credit 2:1) 




Laborarorics (7 & S) 


Contact hours 


.5* 


Credit hours 










(Contact: credit 2:1) 


1.5 








(Contact, credit 3;i) 


2.0 


Indepctkdenr studies (4) 


Number of students (UG) 


.167 


Number of students (UG) 


.02 


Honors projects 




.25 


(G) 


.02B 


Individual lessons <3) 


Number of studenrs 




Number of students 




Undergraduate individual spcciat study 




.25 




.02 


Graduate Indivtdual special study 




.33 




.028 


Individual processes 


— 


— 


Number of students 


.02S 


(private music lessons) 










Student teaching (2) 


Number of students {UG) 


.50 


Number of students 






(G) 


.67 


Supervision 










Observation 


.0125 


Internships il} 


Number of students (UG) 


.5 


Numberof students 


.05 


(G) 


.67 






SeniCi lio*^ thesis 


Number of srud^ts 


.5 






Ph^Dr cornn irtcc chairperson 


Number of students 


1.0 


Number of students 


.08 


Ph*D- comm.Hcc member 


NuiTibcr of students 


.2 


Number of students 


.08 


Master^Sbihes s commitEoe chairperson 


Number of students 


.5 


Number of students 


.028 


Master*s thesis committee member 


Number of studertts 


.2 


Number of students 


.02B 


Master's non- hesis committee chairperson 


Number of srudcnts 


.3 






Mastcr^s non>t icsis commktec uvcmber 


Number of students 








Practicum 






Number of students 


.08 


RcscafcK/cefatcc activity 






Number of students 


.028 


U/kdergrad late a-lvisecs 


NuiTd>er of students 


.033 






Committees 


Number of commiuees 


.67 






Professional activi ics 


Each rTEF 


3.33*' 






Related activities 








3.0** 



Average faculty k>ad 
Dircet tttstruciiona] ;:a'V)ty 
Related iitstructtortal acttvi:^' 
Related ptofcssional activity 



Credh hours 
Credit hours 
Credit hours 



'AJJusiniKnt ractof (S incfcascd by course tevet atkJ ctais size l^tor 
**Assuni«d for each furt-tjine equivalent racutty tITEF) 



9 

4.33 
3^33 

16.66 



Credit hours 
Credit hours 
Credit hours 



9 
3 

15.0 



baste units (credit hoursj eontact hours, or nun)E>cr of students) 
differ for activity dasses and for clinii.-s and laboratories. In 
"dditton, the adjustment factors at university I ai^ increased 
for large elasscs at each eoursc level. 

Both fonnulas also include work-load units for related 
work load units for professional activity for each faculty mcnn- 
bcr(3.33 for university 1 and 3.0 for university 2). Professional 
activity includes university and community services* profes- 
sional devetopnncnt> and scholarly activiti-is. 

Both fonnulas also iiicludc work load uniis for related 
instructional activity (4 33 for university I and 3.0 rbr urtivcnily 
2) This activity includes student advising as well as committee 
and faculty meetings for planning educational programs. 



The total number of work toad units for each faculty 
member sums to 16.66 at untveirsity I and 15.0 at univcrstty 2. 
These respective wurk loads can be used to dctcrmitie the 
number of faculty needed for the total instructional program. 
Each discipline or department calculates the number of work 
load units thatmsuh when the fonnula ts used for each tn^nic- 
tional activity. The total number of work load untts is then 
divided by 16.66 at university 1 or by 15.0 at university 2. 

Comparisons of the Applications of the Two Fot^ulas 

The School of Education and the College of Engtnecring 
provide the best example for comparing the results of the 
application of the two formulas for detcnnming faculty work 
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Tabic 2 

The University of Colorado at Denver 
Compansons of the College of Engineering and the School of Education 
on the Five Mcasufes ofFaeiilty Wcrk Load 



Bqtiivaleni 
Work Load 



Credit Hours 
Number Percent of 



Student Ciudii Hours 
Number Percent of 



Coniad Hours 
Number Perccni of 



Average Number 
of Students per 
Faculty Member 





Umversity 1 


University 2 




total 




total 




(otaj 


(classes of + 1) 


EngEr^eeting 




















faculty members 




















1 


25,3 


24,5 


25,5 


6,2 


513 


8.9 


25.5 


8.3 


26 


2 


21,55 


23,03 


22 


5.4 


501 


8,7 


24,5 


8.0 


21 J5 


3 


25J6 


22,29 


30 


7,3 


4S0 


8.4 


25 


8.2 


30 


4 


23,06 


21,17 


32,5 


7.9 


213 


3.7 


22 


7,2 


13 


5 


19,5 


21,04 


20 


4,9 


538 


9.4 


25 


8.2 


3S,5 


6 


22.08 


19,73 


39 


9,5 


351 


6.1 


25,5 


8J 


24,7 , 


7 


24,57 


19,04 


49.5 


12,1 


355 


6.2 


29 


9S 


22,5 


S 


]S,IS 


17,13 


18 


4,4 


495 


3.6 


16,5 


SA 


33 


9 


15,16 


16,06 


21 


5,1 


520 


9,1 


20 


ts 


32,75 


10 


17.00 


15,22 


34 


8J 


232 


4,0 


16 


5,2 


17.5 


11 


15,79 


13,66 


28 


6.8 


310 


5.4 


17 


$S 


26,9 


12 


13,78 


13,16 


36 


8,8 


380 


6,6 


18 


5,9 


36 


13 


13,80 


13,00 


13 


3,2 


372 


6J 


13 


4,2 


28 


14 


9,49 


12,09 


22 


5.3 


155 


2,7 


\9S 


6/4 


28 


15 


10,82 


9.61 


19 


4,6 


330 


5.7 


10 


3,3 


42 


Totals 


275,44 


260,73 


409J 




5745 




306J 




42040 


Education 




















fjacttlty members 






















45,34 


31.7 


43 


6,9 


892 


14,0 


31 


8,6 


12 


2 


25,26 


23,67 


39 


6,2 


396 


6,2 


23 


6.4 


19.6 


3 


31.69 


27,33 


51 


8.1 


363 


5,7 


28 


7,7 


18,8 


4 


31,20 


27,28 


48 


7,7 


422 


6,6 


23 


6,4 


19 


5 


38,61 


26,98 


81 


12,9 


306 


4,8 


31 


8,6 


7,4 


6 


20,38 


24,50 


66J 


10,6 


341,5 


5,4 


36J 


10.0 


21,2 


7 


31,81 


23.16 


30.8 


4,9 


377 


5.9 


18,5 


5,1 
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28.85 


22,68 


38 


6,0 


6S6 


10,8 


24,5 


6.8 


37 


9 


17,80 


20,89 


23 


3.7 


189 


3,0 


19,5 


5,4 ' 


13 


10 


23.69 


18.48 


37 


5,9 


386 


6.0 


17,5 


4,8 


I9J 




22,51 


18,24 


40 


6,4 


316 


5,0 


20,5 


5,7 


24 


12 


20J8 


16,69 


^5 


5,6 


356 


5,6 


24 


6.6 


27,8 


13 


21,71 


16,56 


53 


8,4 


686 


ia8 


25 


6.9 


37J 


14 


14,52 


13.5 


9 


1,4 


ISO 


2,8 


8,5 


2/4 


20 


15 


1241 


12,02 


13 


2,0 


199 


3,1 


12,5 


3J 


I6J 


16 


11,56 


10,55 


II 


1,8 


159 


2S 


9,^ 


2.6 


17.5 


17 


9,00 


9XK) 


9 


1.4 


102 


1,6 


9 


2,5 


11.3 


Totds 


406.92 


34E.23 


627.3 




6356.? 




361.5 
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load. Both formulas shoA a htghcr \ivork load for education 
(Table 2). Education ha& amuch larger proportion of graduate 
level courses, and jt has only upper diviston courses on the 
undergraduate level Engineering has a predominantly undcr- 
iduate prograni. Consequently, the average work load of 
<4Culty members in education is increased by the Imiger adjusi- 
ment factors used at the graduate level of instruction. This 
situation raises questions regarding die jui^lification of Ihe use 
of the larger adjustment factors at the graduate level. 

The comparison of the results for engineering in the use iif 
the fofmulas of the two universities reveals that there is a 14,7 
difference in the total number of work load units, \ivith the 
fofmuld of university I prrJuJng the higher figure. The 
differential for education -j 58,7, with the higher number of 
workload units also resuiti .g from the university ] formula. In 
the Comparison of the effects of the two fiirmulas in the 
production of the total w^rk load uni;s for education and 
engineerings there isa 131,'i diflfitrcnce when fonnula 1 is used 
and an 87.5 difference usi.tg fonnula 2, 

These comparisons show that, bodi within a school <x>llegc 



and between schools-colleges, the fiirmulduf university 1 resulE±> 
jna higher number of work liiad units. This is due to the higher 
adjustment factors tn that formula and the a4iit^inient for large 
classes. 

The Effect on Individual Faculty Work Loads 
of the Use of the Two 7orm ulas 

How well docs each of the fonnulas compensate fiir the 
wide varia lice s between two faculty members in thetr number of 
credit hours taughtt contact hourst an<f ^udent credit hours 
generated? Table 3 compares faculty meitibers 7 and 9 in 
relation to their respective proportions of the total work U^ad of 
the College of Engineer'ng, using the five workload measures, 
credit hours taught, contact hourst studentcredit hours, formula 
1 and fonnula 2 workload units. The rcsultsshowthat, whereas 
faculty triembcr 7 ranks first tn his or her percentage of cn^it 
hours ano ,ontact hours, faculty member 9 ranks eleventh and 
seventh respectively. On the other hand, facully member 9 
ranks second in student credit hours generated while faculty 
member 7 is ninth. Using the two fonnulas to calculate work 
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Tabic 4 



The University of Colorado at Denver 
C:»inpari5ons of Engineering Fatult> Members Sever* and Nine 
on the Five Work Load Measures 



Work Load 
Measura 



Faeulty 
Member 7 



Faculty 
Member ^ 



Rankin Fercemof Rankin Percent of 

college college local college colkgc local 

Crcdithours I t2.0 II 5.0 

Contact hours t 9,5 7 6.5 

Student erettit hours 9 6,0 2 9,0 

Formula J units 3 8.9 II SJ 

Formula 2 units 7 73 9 6.2 



load units, faeulty member 7 has 8 9 percent of the total college 
units resuhing from the use of formula 1 and 7.3 percent using 
formula 2 Faeuhy member 9 has^.^ percent ofthetotaleollege 
units using formula I and 6,2 percent using formula^ (Also see 
Tabic 4.) 

The conclusion is that the formula for university 2 com- 
pensates more effectively for variances in the numbers of credit 
hours taught, contact hours, and .student credit hours of faeulty 
members 1 an<3 9 than docs the formula of university L 'Hie 
conclusion is based on the LI percentage point difference 
between seven an<3 nine in (heir proportions of the total work 
Ioa<3 units of the col lege produced from formula 2, while there is 
a 3.4 point difference using formula K Justification for the 
conclusion that formula 2 compensates more effectively is 
evident from the following statistics that show for faculty 
member 7 the hffh number of crctJit hours taught and low 
number of sti!^::[ crc<lit hours generated* contrasted for faculty 
9 with the high number of stu<knt cre<lit hours and lower 
number of contact and credit ho^^rs* 

Conclusions 

I The input variables— cre<3!t hours taught and faculty 
contact hours — and the output variable^ student credit i^ours^ 
are notcffcaivc in providing comparable faculty work load^kfor 
the varied types of academic activity. 



The University of Colorado at Denver 
Cumpori^on^ of Engineering Fd^^ulty Members Seven and Nmc 
On Number of Credit Hours Taughti Contact Hours> 
and Student Qedit Hours Generated 



Work Load Measure Faculty Member 7 Faculty Member 9 



Credit hours taught 
Contact hours 
Student credit 
hours generated 



49.5 
29.0 

355.0 



2L0 
20,0 

520,0 



t. The conceptual base of formulas that use adjuStiDcnt 
factors to ascribe weights to differentiated types of activity 
appears sound. The results of the use of formulas reveal that 
they are effecti ^c m moving towards comparable work loads in 
varied types of academic activity and that they compensate for 
variations in the input and output variables of credit ^^urs 
taught, faculty contact hours» and student credit hours produced, 

3, The formulaof university 2compensates better than the 
formula of university I for the variances between faculty 
members 7and 9in Table 3 On thecr."*'* * uur, contact hour, and 
student credit hour measures, 

4. Though the conceptual base of the above formulas is 
sounds a great amount of work remains in providing adjust- 
ment factors that asenbe accr bie weights for producing 
comparable work loads for faculty in the varied disciplines. 
Some remaining qucistions are: 

a. Should the adjustment factor for graduate^ level in- 
struction be greater than that for undergraduate instruction? If 
so» how much greater should the adjustment be and how may it 
t>e justified? ^ 

b. What is an acceptable adjustment factor for non- 
lecture types of academic activity, e,g,, laboratories, intem^'dps* 
student teaching supervision, independent study, theses, etc.? 

c. When should credit hours*, con tact hours» or number 
or students t>e used as a base unit related to adjustment factors? 

d. How should facuhy work load relate to unit costs 
(e,g., coM!k per student credit huur, cost^k per credit hour) in the 
aiiocation of resourccis for disciphnes? 
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MEASURING FACULTY ATTITUDE TOWARD 
FACULTY DEVELOPMENT IN ACADEMIC 
PLANNING 



Philip C. Winsiead 
Fitrman University 



Furman University h currently engaged in a three-year 
project (September 1975-August 1978), with fi grant Trom the 
W,K, KeJUf^Founclation* to develop incliviclual faculty mem- 
bers' skills in academie planning. The prograio in Toculty 
development in aeademic planning is <icsignci] to extend to the 
Furman faeulty the bcneHts ora successful manageiDent planuiug 
process empbyed by administrative personnel at theunivert^ity 
for several years (Winstead, 1975). 

Administrative Management Planuing Program 

The administrative iTibnagemcnt planning program stie'/ocs 
panicfpative planniug* improved oomiDunication, and the use 
of objective research in plauning and decision making. The 
process is organized around data categories iicedcd to provide 
informut'iori for decision making based on a trip analogy. Where 
are you** Where do you want to go? How do you get there? 
When do you want to go'* Who isgoiug with you? What wiW it 
co^t? Ho w do you know when you get thefc?These trip analogy 
questions provide a way to gather information and organize it, 
so that information will be available when and where it is needed 
for planning and dec is ton -making purposes. The systeiD pro- 
vides a way in which purpose* goals, objectives, basic data* and 
other elements of systematic institutional planning ean be inte- 
grated into ongoing adniinistraiive processes. 

Academic Hannfug 

AhhOugh the approach described ha^ proven effective in 
the ndministrative sphere, it was realized thatt until the efforts 
at Furman in systematic institutional planning included work 
with the faculty and in sub^-tantive academic areas* rcnl benefi! 
would r'ot accnte to students in the elassroom. Therefore, ihe 
move inio a pro-am in Faeulty Development in AcadetBic 
Planning was a needed follow-on Among ;he objectives of the 
program are* 

1. Develop and implenfient an ongoing institutional pro- 
gram 'or faculty development in academic planning. 

2 Involve more faculty in the pinnning process and 
pnVide essential suppon serviees to faculty for planning 

Make faeulty more aware of innovative and ^uccesi^ul" 
academic pro£' :ms in other colleges and univert^ities 

4 Increase the exposure of faculty to specialists in aca- 
demic planVmg and to leading professionals in the various 
academic disciplines 

^ Update and upgrade Ehcexpertisc of faculty in systematic 
planning principles and procedures. 

'Hjtse objectives are laudable from the viewpoint of the 
administration of the university But what arc the attitudes of 
faeulty toward systematic academic planning'* Do faculty nficnfv 
bcrs see a need for traming and developnfient in academic 



planning? Do they see personal and professional weaknesses in 
themselves in an area such as this? 

Evaluation Design 

The evaluation design put forth iu the proposal to the 
Kellogg Foundation for the Faeulty Development in Academic 
Planning project iucluded as n part of the research methodology 
an inventory or pretest of facul^ attitudes "jwaidthe basic ptan- 
uing priitcjples and procedures being contemplated as well as an 
assessment of faculty feelings toward the proposed program and 
toward their need for training anddcvelopmciit in thts specialized 
area. Also, thepretest was designed to determine whether or not 
;he faculty members at Funnan believed certain planning tech* 
niques being used in the administrative area were appropriate in 
traditional academic planning activities such as eonstnicting 
new programs of study, developing new courses, Revising new 
instrxictional strategies, andtevising existing programs, courses, 
and procedures. 

The inventory, or pretest* was developed during the fall of 
1975 and administered in December of that year. 'The survey 
was distributed to the 145 members of the faculty, and 105 <72 
percent) responded. The instr\iment was divtded into four parts: 
Part 1, personal information, Pan fL fneuliy members' present 
feelings about basic premises put fonh in the onginal Kellogg 
proposal; Part ill, information about faculty involvement in 
planuing; and Fan fV, opinions ^ut the proper role of faculty. 

Data Analysis 

Response^-io Part 1 revealed that the Birman faculty is nn 
experienced faculty (three out ofHve of the respondents having 
been at Funnan six years or more) withan average number (1-2) 
of committee task force assign men ts* Furman isonathrce-tenn 
(12-8-12) ne adc mi f: calendar. Most faculty mnintain a regular 
tcnching load (24 semester hours per ycnr) witli each person 
normally teaching six courses (4 credit hour course base) per 
year or two courses per term* 

To the 23 statements in Part II representing the underlying 
planning concepts stressed in the original Kellogg proposal, 
respondents were asked tomark one of the following re^nses. 
{I> agfee stronj^ly, (2) agree, (3) no opinion, (4) disagree, 
^^5Mte>gtte strongly. Nearly all of the faculty j(96 percent) 
agreed or strongly agreed that a systematic approach to academic 
planning ts imperative and that faculty members should be 
involved. Ninety-six percent responded that sound planniug 
must be based upon areaiistie understanding of the basic nature 
and capabilities of the institution. Thfee*founhs agreed or 
strongly agreed that planning helps clarify dceisbn -making 
responsibttity. Four out of five agreed that a plauning program 
helps provide essential informatbn when and where it is needed 
for decision^-making purposes. Eighty percent said that ihe 
quality of planning and decision malcing cannot consistently 
rise above the quahty of the information on which it is based. 
^^1rc than half (55 percent) approved of the use of outside 
consultants to help faculty members examine program altema- 
tivest They considered usually helpful ( I ) visits toother lustitu* 
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ijon^ to CAdmtnc innovtiuvc prugrtim^ when t^oibLJciing tinJ 
JcLiJing upon po^Mble toun>c^ i^f auton tin J {2} ^pccjtil t^ampu^ 
tolloquiti on pcfiincn[ topics lo :>tLmuldic thought 4nJ gcneiaU 
tJea^for improved juidt^mic eftort>. Ninety ^ncpcrccnitigrce J 
or ti^rec J :>trongl> ihji there exiM^ tn lo^ty \ auiiJcmic environ 
ment tin intmcfation of P4ru> of [ht;^ univcr^it> and uA»mpleAitj 
of c JuLtitional proccv^, orgtiniZtitiontil ^tritLturc^, tin J operti 
{ion of colleger thtit re^uirc^ ^>:>tenititiL pitinning. More than 
nine out often (94 p<^ent> agrcej that auLeptance and ^uppon 
of effeLtiie implementation rcqujre^ the ^uppon of the ke) 
people ^ho are iniokeJ or affected.* and four i^ut of fiie 
favored aeaCion of conditions and provision for a planmng 
process that v^ill make it easier for ever^ person involved to 
participate effeetively. The majority (72 percent) agreed that 
planning is more effeLtive ^hen it taJ^c^ place as clo^ as 
practical to the point of Eventual implement4tion. and 90 
percent thought plans for Ctich area must he coordinated vvith 
other areas to achieve the ba^ic purpose 4Jid goals of the 
institution. 

There ^ere onI> three of the 23 Matement^ li^ed v^ith 
v^hicn a large nuir.hcr of faculty did not agiee. About hjlf t4S 
percent) dij not agree that systematic planning v^ill enable 
faculty to do a bj^tict job without additional time and efTon on 
their pan. FoHj^four percent disagreed that many faculty mem- 
bers r>eed spceialized training.tn research, statistics, and other 
tools required for effective planning. Qn otie statementi re- 
sponses were almost equally divided; slightly more than half 
{5 1 percent) bellev ed that the average faculty member does not 
have the necessary time or resources to engage effectively in 
planning. Some faculty members criticized Part 11 of the ques 
tionnaire a^ being gencrni statements that were "loaded'' and 
required definition of terms for accurate ansvver^ to be given. 

Faculty members ^ere asked to respond to the statements 
m Pan IIL ab,tut the Funr^an University climate for planning 
and decision making, using the >ame five-point scale (agree 
strongly to di^gree strongly) used *n Part IL In ihis section, 
there M^eresiA statcmenb tout of 25) ^jth v^^hichthc) agreedand 
none ith v» htch the majorit) disagreed. Opinions were split on 
the othct 19 s^itements so as to make the results mcondusivc^ 

Nine out of ten facult) members agreed that moM facuh> 
^em to be very loyal to Funnan and are strongly ^mmittc J to 
the acknowledged purpose and goals of the institution. They 
agreed {94 percent) that the faculty are serious and purposive 
about their work, and 90 percent thought that some arc active in 
experimeRting with new methods of teaching.* new Loutses* and 
other innovations. The majorit) (70 percent^ believed serious 
consideration i> given to student opinion when policy and 
program dcciMons affecting students are maiie. Seven out often 
have found planning tcchntques such as the SWOTs Analy>i6 
(an acronym for strengths, weakne!>M;s.» opportunittes, and 
threats) helpful in the planning process.^ 

Opinion ^^as divtdedequall) . mong tho«>e who agreed and 
di^agK^ed that factilt) morale is hi^.i at Furman and that there js 
an air of complacency among the faculty. Two out of five 
fa^^ulty mernbcrs expressed the belief that proposed curricular 
changes are accepted or rejected more on the basis of financial 
con>ideration than on educational merit, two in five disagiv^ed* 
and one m five had no opinion* There vvas division of opinion 
among faculty about v^heiher attempts <ir^ made to involve in 
decision making individuals who v^ill be directly affected or 
who are interested Mrithout regard to their formal position or 
hierarchical status* Opiiiions were divided equall) among those 
who agreed, disagreed* or had no opinion as to whether lading 
plans for the future of Funnan is a high priomy aett^ity for 
many Furman faculty members. 

Part IV asked for faculty opinion concerning the proper 
role of the faculty in vanous platitiing and decision making 



areas of the university from among the following responses, 
(1) decide alone* (2J decide jointlyr (3) advise onl>i (4j no 
formal rolci and (5) do not know. Only in the area ofcumcutum 
did 4 large percentage (44. S percent) of the respondents believe 
that the faculty alone should make llie plans and decisions, rhe 
majority (53.3 percent) thought plans and decisions in this area 
should be arrived at jointly. The largest numbers of faculty 
thought plans and decisions should be amveJ at jointly jn the 
following arens, (I) athletics^ iZ) budget allocatuns, \3> cur 
Hculum, (4) faculty appoinimenb.* (5/ faculty status (policies). 
(6) faculty status (specific decisions).* (7) faculty v^ork load.* and 
(S) student admissions. Tw^out of five believed that the faculty 
should advise only in the areas of administrative appointments 
and student financial aid. 

Space \vas provided at the end of the questionnaire for 
faculty members to list the issues they felt were unresolved at 
Furman and required study and planning. A third of the re 
spondenb listed the role of intercollegiate athletics at Fuiman. 
Next most often mentioned (by 21 percent of respondents) were 
faculty concerns such as consistency (from one person or 
department to another) in the basis for detiding faculty load, 
salarie:^, lenurti responsibilities in and out of class, reward 
system,, etc. j^elated were several questions such as what is 
expected of a "loyal" member of the faculty and what is the 
''faculty function," 

Formative and Summative Evaluation 

The survey results provided both formative and summativc 
evaluation data. Formative evaluation is assessment during the 
course of an activity ^hile there rs still possibility of modifica- 
tion. Summntive evaluation takes place at theend of an activity 
and deals primarily with the outcomes or end results (Bloom, 
Hastings, Si MadauSi 1971, p.* 20)* As n foimative evaluation 
deviLe, these data provided the Kellogg project leadership with 
indications of receptivity toward vanous activities envisioned 
for the project. For example, minimal time was spent earl> in 
the project on general sessions designed to convince the faculty 
of the need for Hs;jrstematic planning or the faculty's role and 
responsibility in academic planning, the pretest indicated that 
Ftirman faculty already shared these v tcw^s. Rather, ear[> effons 
highlighted basic planning principles and techniques dnd how 
these procedures are appropnate for academic as well as ad 
ministratLve planning effons. Also, the pretest led the project 
leadership to emphasize the suppon services available for 
fat^ulty involved in academic planning. Thetr desire and need 
for adequate time, secretarial suppon. consultanb, and travel 
possibilities came through in pretest assessment. Moreover the 
colloquia tiipics (e.g., faculty evaluation.* general education, 
values, alternative teaching modes) were chosen based on the 
indications of need supplied by the respon^v^s to the Sur^c> 
in.stntment. Flnallyj the elear reeognltlon by faeulty of the 
complexity of educational instiiuttons like FutiTianatid the nei;d 
for improved communications^ especially in an area such us 
program planning, was taken into consideration b> the project 
leadership as the> managed and monitored the program. 

These same pretest findings, usedas baseline data, will aid 
in the summative evaliration at the inclusion of the projccL in 
197S by allowing the project evaluators to verify change over 
time. Not only is il expected that faculty :iiembcrs at fumian 
will be iiiore proficient m planning and more knowledgeable 
about planning procedures but that Ihcy will also have more 
po.siLivc attitudejv i^-'.jfd systematic academic planning; and ihe 
need for coordinated faculty devclopinent m thi^ .specialized 
area of their profes.sional job, 

Conelusions 

To date, 41 faculty member^ ffmm a teaching faculty of 
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145) representing 19 departments <out of 22 departments) have 
eondueted. or ai^ eonducting* aeaJemte planning projects a*> a 
part of the Kellogg supported prognm Tn addiiion* nearly all 
of the Fufinan faeulty have attended or or more of the 
eollo()uia* planning orientations, or othet speeiaJ activities 
associated with the Faculty Development In Aeademic Planning 
Program The pretesi survey hus aided greutly, according to the 
project leadership, in the guidanceanddirectionofthe program. 
In addition to producmg the baseline <lata needed for evaluation 
purposes, it has provided help tn the selcctton and conduct of 
ihe specific activities which comprise the program and hjs 



given focus «ind direction to the project. The pieteM ha!> also 
been helpful as colioquia topics were chosen anc^ program 
dcijih were developed. But nioM importantl^i the recognition 
of certain faculty attitudes toward ^cutty development in 
academic planning has been vutuablc in deteimtmng thc^hniM 
and d'lv-tO'day operation of the program. 

FmaJly. the survey methodology of the preteM and the use 
of a seric!> of statements^ requiring scaled rc^ponses produced 
data v^hich were easily analyzed and could provide usef\il 
information for the program and projcet planning necessary for 
the Furman F^uJt> Development in Ac.^'':mic Planning Pfogram, 



Footnotes 

'A n)py of tbc mstmmcnt ^^^tlabtc fr^w Furm^^n l/ni^orMtyS Office of fn 'ilutiocijl PUftnii^ and KoCi^rch 

'SWOT^ Aa^Ivms h a pftKcdure of Sili ^ndVM> and ncc<)> ^\es>mcnt <t<:velopcJ as pan of the Furman UnivOrMt> M;iiiaf cni«nt PJjnnin^ MpJcI lot Liberal Att^Coltegcs 
Jtscl<)ftf4l ufMJtr^nK fnjcii The ForO FooiuJadon and <hc Exmut Education Foumlauoit 0972-75) 
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FOR IMPROVED STUDENT CHOICE* 
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A recent Impetus to provide more complete and accurate 
infonmat'ion to facilitate student choice among postsecondary 
institutions has stemmed primariiy from new regulations 
which require institutions to supply such data as student reten- 
tion rales and job placement rates to aJl applicants (Stark. 
1976), These r&(]uiremcn[s have been base<^on the assumption 
that educational programs at institutions which have low reten- 
tion and placement rates represent a poor investment of time 
and money for students generally, CoHegps have strongly 
chaJJengedlhis assumption^ citing their diverse purposes* pro- 
grams, and student bodies, and pointing out that students may 
make inappropriate inferences if such outcome measures are 
presented without careful interpretation (BJ-Khawas, 1977). In 
the study reported here, the investigators began with the as- 
sumption thai informmg students about educational processes 
which they can directly relate to their own situations may have 
more utility for improved choice than simple discrete facts 
about an institution. The puq>ose of the study was to 4ctcnmine 
if, in malting hypothetical college choices* students who read 
descriptions of educational processes appear to relate material 
contained in these descriptions to their own self reporicd e<lu- 
cational needs. 

Background 

The investigators viewed infbnmaiion which mightbe dis- 
closed to prospective posisecomlary students as failipg into 
one of the four catcgoncs illustrated in the diagram below. 



Students typically Students typically 
ask do not ask 



Considered 






important by 


Cell A 


Cell B 


educators 


Easily comparable 




Not considered 


C&IIC 


CcllD 


important by 




Comparability 


educators 




not essential 



Diagi^ L Siudcnt information-seckmg in collcec choice 



Most recent efforts to improve information- for student 
choice have focused on Cells A and C in the diagram, first 
determining what questions students typically ask and then 
attempting to supply the specified information (Kinnick and 
Lcnning^ 1977) Little attention has been given to other ques- 
tions that students might ask if they were more fuUy aware of 
factors which might affect their education and were encouraged 
by educators to make earcful self-assessments of their educa- 
tional ^ eeds It can be argued that educational institutions have 
an obligation to encourage students to ask questions which fall 



in Cell B tn order to obmin all informatioii which may be 
important to making an appropriate choice. 

Based on this rationale, this study focused on two ques- 
tions which students may not typically ask but which may 
directly reflect the nature of the educational program offered 
by a college or postsecondary school, 

1 , What types of services are available at the institution 
that will help me plan, select, and carry out learning activities 
which are appropriate in terms of my parti cularabiiaies, needs 
and interests? (For simplicity, such services will be referred to 
as individuaHzed academic programming^) 

2. What services does the institution provide which will 
assist me in planning a career in termsofi^ty particular abilities, 
needs> and interests? (Such services will be referred to as 
career planning servicts,) 

Students seeking answers Co these two questions will need 
descriptive information whtch hdps them detenninc what actions 
the institution is likely to take in regard to their education and 
development. Thus, the study was conducted in two phases: 
(a) an attempt to determine if comparative descnptions which 
provide answers to the two questions could be constructed 
across diverse postsecondary institutions; and (b) an attempt to 
determine the usefulness and salience of these comparative 
materials to students planning postsecondary study. This paper 
discusses only the second phase of the investigation; a discus- 
sion of the problems encountered in constructing comparative 
descriptions is reported elsewhere (Stark, Leahy and Milley* 
1976). 

Procedures and Samples 

Question naires* college publications, and interviews with 
129 administrators and faculty members at nine diverse institu- 
tions provided the data necessary to construct realistic compara- 
tive descriptions answering the two primary questions and 
several sub-questions. The investigators took special care to 
make the quest ion^and 'answer style descriptions as accurate 
and comparable as possible. Nevertheless* because of the 
diversity and inconsistencies among colleges, the descriptions 
sounded somewhatVague, This was particularly true for career 
planning services which were not a top priority at most of the 
instittrtions* 

Four of the college descriptions' were used to investigate 
the following questions among college-bound high school 
students, 

1, Will students who read informative nfiatcnals about 
educational proce^tses be stimulated to view the types of in^ 
formation discussed as nf>oie essential than if they had not read 
the nvatcrials? 

2, What information itcim do college-bound students 
feci arc most essential in making a chotce among colleges,' 



*The authors gratefully acknowledge the support of the FuimJ for the Impixi^nieni of Pu^iictOiMJaiy EducaKon, HEV/^ Cirani Nunit)cr 000-75-03668, 
All opinions expressed arc ihosc of (he authors and not of ihc fUndii^ agency. 
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3. £>o students see the descriptive materials provided as 
useful jn college ch«JKe? As Jear and understandable? 

4. Do students viho view particular s^alegones of in 
fonnation important diffei on self reported a^^ademis. or 
^.ajeei coutiselin^ needs from those students who attavh LttU 
importance to the same eaiegories of information? 

5. Arc students likely to express a prcfercnce for an 
institution wLich describes sefvis^cj^ to meet their perceived 
aeademte and carcer counseling needs? 

Random samples of cotlege-bound juniors were drawn 
from three high svhooUi Kttated in a suburban areat a small 
town, and a rural area.' One-thtrd of the students were ran- 
domly assigned to a coiitrol group and two-thirds to an expert 
mental group. Since not all students who were invited agreed 
to parttcipatci the final ^mples are not necessanl> rcpresenta 
tive of the high schools from which the> were obtained. 
Usable responses were obtained from 43 students av^igned to 
the control group and 83 students a^^igned to the expenmenial 
group. 

About 80 percent of the students sampled planned to 
attend a publiv or private four >ear college or universi(> upun 
high schock graduation* the rcmaining 20 percent planned to 
attend a public two >ear college or vocational school £ight> 
SIX percent indicated one or more tentative]> planned courses 
of stud>, 14 peR,^nt expressed total uncertainty aknit a career 
goal or college major. Over 80 percent of the students de&vnbed 
theif high sehool grades as nK>stl> As or nK>stl> Bs. 

Students 5n the. control group (N-45) werc asked to rate 
the importance of twenty five items of mformatton pertinent to 
college choice and to contribute dcniographtc information about 
them]»elves> Students in the experimental group responded to 
these same i^uesiions but onl> after first reading the four 
sample college descriptions, two dealing with academic pro 
gramming and two with ^.areer planning services. Additionally, 
the experimental group completed an adjective check list to 
a\sess the usefulness of the information in each t>pc of dcs<.np^ 
tion, ranked the four unidentified colleges according to their 
personal preferences, and gave reasons for their choices. 

Instruments 

All iniitruments used in the stud> were constructed b> the 
investigators. Students rated twenty five items of information 
rclevant to college choice on a four-point scale from (l) 
abkulutely essential to (4) not at all esscntiaL The items em 
phahized information m the sample college descriptions and 
cxnitted co&t and financial aid opportunitiesi since this m 
rformation is already known to be essential to college chot*^ 
(Davis and Van Dusen,. 1975). 

Self rcponed information provided a basis for classifying 
iitudents according to degree of car^r certainty and self 
assessed academie capab til ties. 

Stu dental who read the four^llege descriptions reacted to 
eai'h set -caiccr planning services and individualized academic 
programming ^n a separate 24 item adjective ^.heckliM pat 
terned after one devised by Kelly, Pascareliat Terenzim* 
& Chapman (I9?6> for obtaining st.ident reactions to course 
experiences. The stimulus for response was in the form 
found the information about (career planning services) to he 
, . /* Ratings ^cre made on a four point scale ranging ftom 
(1) extremely to (4) not at all. 

Results 

On the basis of < ^square analyses*, the experin^nta) 
and control groups werc judged to be ver^ similar in agCi 
college planji, and other demographic, variables. No significant 
differcnces werc found between the two groups on such self- 



reported variables as reasons for planning to attend college, 
number of college catalogs previously read, number of exemp- 
tions expected from required college courses^ amount of neces- 
sary extra academic help anticipated in college, difficulty ev 
perienced with high school course work, self assessment of 
stud> skills, or degree of certainty about a carcer choice. 

It was hypothesized that reading information about career 
planning services and individualized a^^ademic programming 
tn the sample college descriptions would raise the consclous^ 
ness of students about these issue-. The experimental group 
was expected to rate related items on the Essential Information 
Scale as significantly more important than the eontrol ^roup 
which had not read the descriptions. The hypothesis was 
rejected* although seven of the twenty fue items werc rated 
differently by the two groups gf students^ the items and the 
direction of the differcnces in mean ratings seemed to bear no 
relationship to tlie materials read by the experimental gfoup^ 
The items which differed significantly when t tests were used 
■o compare group means arc indicated in Table I - Because no 
differences which could be attributed to reading the college 
descriptions were found between the experimental and control 
groups^ the grQups were combined for additional analyses. 

The Items of information most essential to college choice 
as judged by the high school students are displayed m Table 1 
in orderof importance. Students appeared to be most interested 
in course descriptionsi <}uality of teaching* and job placement 
success rccords, as well as in various aspects of the college 
social envjrDnment> They were least interested in the cx>llege's 
attrition rate* the types of students who attend* and the extent 
to which students use the career planning services> 

In order reduce the number of information categories 
under consideration for examination of relationships between 
students' judgments of essential mfvrmation. self reported stu 
dent demographic variables* and hypothetical college choices* 
responses to the Essential fnfonnation Scale were fa^iof analyzed 
by the principal components method with vanmax rotation. 
Nine categones of interconelated items were represented by 
the nine factors which exhibited eigenvalues greater than LO. 
These nine factors accounted for 65.8 percent of the variance 
in the responses. Faetor seale scores for each rcspoitdent were 
constnieted by selecting the eharacteristic items (loading above 
.40) on each factor, summing the raw response scores for these 
ilemSf and dividing by the number of variables summed. The 
items which comprised eai^h scale anu the characteristic factor 
loadingsare given in Table 1. Coefficient alphas for the scales 
composed of more than :wo items ranged frcm .61 to The 
results indicated that students see items of information about 
colleges as intenelated> fnterestlngl^i sevem! items originally 
included because the investigators had deemed them rclevant 
to judging the ade^^uacy of career planning services did not 
load substantially on any fuetor> It appears that students^ much 
like the colleges themselves (Stark* et al.) did not see career 
planning as a total process related to their education. A high 
scorer on each of the nine scales would be described as follows> 

Quality of teaching, This student considers information 
about the teaching processes of the ci^llege importantt including 
ratings of aeademte (Quality. 

Sociai environment. Tins student is concerned with the 
social dimensions of college* including living arrangements 
and student activities. 

Counseling services: This student is interested in knowing 
about the counseling services available* both academic and 
nonacademic. 

Rules ami regulation. This student considers it important 
to know the ground rules at the uillege* \oth in a<.ademic and 
nonacademic areas. 
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Table I 

Ranking of Informalton Items in College Choice by 
128 High School Students 



J\UUK 


Item 


Factor scale 




ractor loading 


1 
1 


Detailed description of the courses ofTcied in your Held 
of interest 


Course description 




.67 


2 


Bvaluatrop of the teaching of faculty members 


Unnamed scalc*^ 






3 


Percent of students in your ftcfd of interest who got jobs 
in field 








4 


Deseription of student activities 


Social environment 




.54 


5^ 


Description of tiving arrangements 


Social environment 




i 70 


, 6 


Description of s^jrviccs to help you ehoosc and pbn a eaieer 


NONE 






7 


Description of teacfiii^ meiltods used 


Quality of teaching 




, .53 


8 


Descriptbn of social life on campus 


Social environntent 




M 


9 


Student ratings of acaden^c qoaliiy 


Qualify of teaching 






10 


Description ot academic advising system 


Counseling services 




.53 


11^ 


Extra t)c]p available for students in academic difficutty 


Counseling services 




.51 


12 


Advanced opportunities for students who do well 


NONE 






\1 


Description of academic regulations 


Rules and regulations 




.68 


14 


[)cscriptton of special counselii^ help 


Counseling services 




.68 


15* 


Physical description of the coJleec 


Social environment 




.58 


16 


Amount of time profe^vsors spend v/lth stuttents out of <;las5 


Quality of teaching 




M 


17 


Opinions of enrolled students about campus life 


Student opinion 




.57 


18^ 


Description of rutes for student behavior 


Rule^ and regulations 




.67 


19 


How a student may register a complaint aboui an unfair 
academic decision 


Aeaden^e concern 






20 ' . 


Career interests of enrolled students 


Unnamed scale 




.52 




Jnformaiion aboui internship opponuniiics 


NONE 








Description of types of students who attend 


NONE 






23^ 


Percent of students who plan to enter a profession 


Professional orientation 




. ^73 


24 ^ 


Percent of students who use the career planning ofHcc 


NONE 






35 


Percent of students who kU the school bcfon^ finishing their 
program of study 


Student of.inton 







*For<he «vcn items with this supcrscipt. a Sfgnificantdiffenkce (^'< OJ) was fonoJ between students iftihftcnntfo) groupiA/»4j>and (ho« m tbc expcnmenial gnwp 
(^^S3> wly> had read college descriptions R>r items rdnX«d It. 2], jiut 23. Uie diffcnnce in mean rankings was tn ihc opposite direclion from thai hypoUiesizcd. 



indication NONE under a factor scale mew dial ll>c item dnl not have a substantial loadmg on any of the ntne factors extracted. 
^Thc Unttaittcd fK^dlC i\ explainod m ibe (ext. U ^tiiKistcd of ivva items v.iiich did cuit ^^^it to he coiwcftlually lint^cd 

Professional orientation: This student considers il im- 
ponant to know the pcieent of students who pbn to enter a 
profession. * 

Student evaluation of teacfting/ student career interests: 
Students who score high on this scale consider the two items of 
Inrontiation named in Its title as important, ft was undear to 
the investigators why these two items were related^ thus, it is 
termed the Unnamed Scale. 

Academic concern: This student believes that it is ini- 
podam to know what wiH happen to him/her if aeademic 
diflftculties arc eneounfered— botfi what help is available and 
how to complain if academic evaluations seem unfounded or 
unfair* 




Student opinion: This Fludcnt is interested tn the opmton 
of other students about tile college^ as expressed m surveys ^ind 
implieitly in the attrition rate of the Ftudent body 

Coarse descriptions: This student considers it important 
to have detailed deserjpttons of courses and programs. 

Using tbesc factor scales^ students (N= 128) were classified 
into three groups according to their scores. Students who 
scored one standard deviation or more above the mean of the 
total group were clashed as high scorers, that is, those who 
considered the parltcuMr kind of information most essential tn 
col^ge choice. SimiLHyf low scorers were students who 
scored one standard deviation below the mean on each scale, 
while the remaining group of students, within One standard 
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Tabic 2 

Number of Students Classed ^ High* Medium* and Low Scorers 
on Each Infomiation Importance Scale 





High importance^ 


Moderate importance 


Low importance 


Factor scale 


Range of 


Number of 


Range of 


Number of 


Range of 


Number of 




£C<n< ^ 


students 


scores 


students 


scores 


students 


Course <Iescnpt]ons 


< .75 


26 


.75-1.70 


102 


> 1.70 


0 


Teaching evaluations/ 














student career interests 


< 1.24 


12 


1.24-2.52 


96 


> 2.52 


^20 


Social environment 


< 1.27 


23 


1.27-2.37 


75 


> 2 J7 


30 


Quality of teaching 


< IJ2 


22 


L3a-2.54 


93 


> 2,54 


13 


Academic concern 


< 1.33 


9 


L33-3.I0 


89 


> 3.10 


30 


Rules anJ regulattons 


< 1.34 


24 


L34-2.83 


83 


> 2.83 


21 


Counseltng services 


< 1.37 


18 


1.37-2^9 


83 


> 2.49 


27 


Professional oriemation 


< 1.56 


14 


I.5IV-3.33 


94 


> 3.33 


20 


Student opinion 


< 1.8$ 


26 


1.88-3.28 


89 


> 3.28 ' 


13 



^b^^tfivattcm w^> made on the bj^t> of ± one standard deviation, 

A of t inJhjtc> thai ^ludcnt\ feh iltc type uf mfuniutton e^scntuJ. »-ore of 4 inOK^to 'hcj tieucd ih^ .nfomijciitn <^ ntM ji j\i c^»citLijl. 



Table 3 



Relation of Self-Reported Student Characteristics 
Types of Information Students View as Essential^ 



Factor scale 



Reason Have Study Prcpaied Will 
for read catalogs skills for need 

coDege college help 



Will 
exempt 
courses 



School High 
work school 
difTictilt CPA 



Course 
Jeecnptions 

Unnamed scale 

Social envirnnmeEit 

Quality of teaching 

Academic concern 

Rules and 
regulations'^ 

Counseltng services 

Professional 
orient atioi^' 

SttHlent opinion^ 



i[HJti;)tct thai students ^Imj fell the lypQ of mfomuttun on ihc s^ulc vr^s very c^^^nijjti ot M aH e&^cntidl diflered ugnfftijntij ip < v^t Lhc icJt-ccpoftcd 
chamcieri^itc- 

^luJenis *ho fell ibe lyprf t>f infomiaiion cn ihtse scales was highly e>scntt;il preferred Cctrcge B. 
^SltiJenic who fell the type of infomtaiioit on this ^^afe was not at all essemial piefeaed College 
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deviation of the m^n» classed as moderates. U is elear 
from examining these clas^kifieaiions in Tabte 2 that some 
caicgorics^nn formal ion (e g course descriptions) aie con- 
sidered essential by all students For other categories* students 
may judge the importance of infomiation in veiy different 
ways For example* 1 1 percent of the total ^up of students 
considered knowing what portion of enrolled students planned 
professions as cxtfcmcly essential* while 16 percent consideix^ 
it relatively unimportant, 

5cale scores of the three groupsoneachof the scales were 
cross-tabulated with the various self-reported studeni ehaiae- 
teristiesand the ehi -square statistic calculated for each table to 
explore the question E>o students who view particular categories 
of information as important differ on self-ieported charac- 
teristics from student, who attach little importance to the same 
information? 

Statistically significant differeaces(p<, 05) between high 
and low scorers arc noted in Table 3. The most frequent 
differences were found on the single item scale which was 
termed ''professional orientation'* and which had been judged 
as only of moderate importance by students getkeially (X'=2,44). 
Those students with less developed skills* with poorer prepara- 
tion for college, or who fell that they would need help with 
class work, saw information about the portion of the student 
body planning to enter profcssionsas most important. Students 
who viewed descriptions of the social environment as highly 
important tended to be those who had experienced the most 
difficulty with course woHc in high school or those who had 
either social/^r^nal or vocational reasons for college at- 
tendance Students who cited inteUcctual/arttstie goals as their 
primaiy reason for attending cottegc saw descriptions of the 
social environment as much less important. 

In less easily interpreted differences, students who had 
read^ fewer college catalogs saw information conceming quality 
of teaching as most important; students who thought they 
would be eligible to exempt required courses saw as most 
important the items on the tAyo-item scale which fneludcd 
evaluation of faculty and canser interests of students, 

since items relevant to career planning did not emerge on 
any of (he factor scales, a separate analysts was conducted to 
determine whether students who were *'^certain ofcaiecrchoice'* 
(N'22) rated these information items as more important than 
those who were '^uncertain or somewhat uiKertain of career 
choice** (N=100).Twosigniricant rtpsis(p< ,05) were found 
between these two groups on related items; students who were 
uncertain about career choice rated the information about 
career services and informatton about job placement percentages 
as more important 



Table 4 



Ranking of Colleges by High School Students (N=83) 
Who Read Coniparjtive Descriptions 





Most preferred* 


Least preferred 


College A*" 




25.3 


College B 




12,0 


College C 


22-9 


U,5 


College D 


12 





^tti percent uf inAii |2nHJ{» f1C^p^nJmg 



inif^l^ dc^nptMtn i>rCc»lfcECs C orul D itntancci planning «ifrvivcv 



Students in the experimental group who read the four 
college descriptions reacted favorably , more than 50 percent of 
the students found the descriptions to be useful complete* 
clear* practical, relevant, and essential. Less than 50 percent 
found them complex, familiar, strange* or confusing. But 
students did not see the materials as stimulating, challenging, 
or enlightening and tended to sec them as more bonng than 
interesting. The career planning services descriptions were 
viewed less positively than the descriptions of individualized 
academic programming. Only 50 percent viewed career plan- 
ning as essential as compaied to 75 percent for academic 
programming. 

Students in the experimental group were askcU to rate the 
college descriptions from (1) most preferred to (4) least pre^ 
fened according to which school appeared to t>est meet their 
needs (see Table 4), It appears that College D* which described 
only career planning services (relatively undeveloped on that 
campus), was least favored by students, A one-way analysis of 
variance was used to compare high, moderate, and low scorers 
on each information scale with the college choices. An ex- 
planatoiy pattern, based on significam differences, could be 
detected only for College B, College B was favored by students 
who scored {ow on Professional Orientation, high on Rules 
and Regulations and high on Student Opinion, College A is a 
state college. College B is a private liberal arts college noted 
for individualized programs and few rules which apply to all 
students. Although no firm information is available. College B 
is considered by the public to be at least as academically 
demanding as College A, The reasons students gave for prefer- 
ring a given college were helpful m interpreting patterns of 
preferences between the descriptions of academic programming 
at these two colleges. 

Many students chose College A because they felt it was a 
school with extremely high academic standards. Other students 
stated specincally that they did not choose College A because 
they preferred an institution with less intense academic pres^ 
sure. Students wtth social goals for attending college, as welt 
as those who experienee some academic difficulty, chose 
College 3 primarily to avoid an intense academic atmosphere. 
The different views appeared to t>e bascdon the cxplicitness of 
the policies described. For students who sought a flcAiblc 
atmosphere, tncludtng those who considered knowledge of 
rules and regulations as vciy important ^ College A was seen as 
stuffy and ibrmal because of its specific policies. College B 
was seen by many as liberal* not too academically oriented, 
and, therefore, more fair, personalized, and ncxtbic. Con- 
versely, however, some students believed that because College 
A had more explicit policies, students would be likely to get a 
fair Jcal, 

College B was also described, in terms of its career 
planning services* as College D, It was clear that students were 
not attracted to the college when it was described in this 
limited way. College C, a state college for which career 
planning cervices were also de^cribedt^^^s more frequently 
preferred. Several students selected Collcg^l Con the basis of a 
perceived need for its fairly welKdevelopcd career planning 
program. More often, students preferred College C because it 
appeared to offer programs they desired,* As a group* students 
judged course descriptions as most essential information* and 
many selected College C as the only description which provided 
this information. 

Although the descriptions were earefully planned and 
phrased to present information which related closely to the two 
main questions asked* students commonly made inferences 
which went far beyond what the investigators believed could 
legitimately be inferred. For example, comments were made 
that ''the faculty and students seemed enthusiastic,'' ''the 
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college give^ the Mudent abetter chance logci in/' ^eecns to 
be more kOncemed ^iih gotxl edu^auoti as^een through lough 
grading poheies, " "it ^kOunct^ hke bccau^ of the striet lule^ 
Ihey shouJd get good results*^' ''doesn't sound so stnet and 
full of discipline* " and 'offered good extracumcuhr aciivittcs/' 

Discussion 

A relatively small sample of students » not necessanly 
representative of all high school students, and including no 
adult prospective postsccondai> students, ^as used m (his 
study. The eollege descriptions used* while real^ focused on 
only two type^ of information and omitted mueh data whi^h 
students normally would use m malting a college choice. The 
items of information judged by students were selected to 
obtain rankings related to the eollege descriptions provided 
rather than to represent the universe of all possible information 
Items, Simple univariate statJMics iveie used without controlling 
for potential eontaminating variables. For all these reasons^ 
thi^ study should be interpreted as an mmal expk)ratJont and 
the discussion of results should be considered m that light. 

It has been argued that types of information actually 
Supplied by colleges set the norm for what students will view 
as important in eollege ehoice. Although most students in this 
study had not yet read nnany college catalogs, they had formed 
some views about what information was essential. Students 
who read brief descriptions of academic programming and 
career planning services at four colleges did not readily adopt 
tlie view of the investigators that these services were of high 
importance. If educators wish to influence students to make 
choices on the basis of variables they view as important in 
terms of students' educational needs, a more intensive and 
long-term approach witl be needed. 

While 80 percent of the students in this study were 
interested in a steady, secure job as a result of eollege at- 
tendance, and most of them had Only tentative ideas of what 
that job might be, they did not view career planning as an 
essential college service. Students >verc more inteiested m 
placement rates for their tentative program choices. The career 
planning descriptions tended, however, to be vague, like the 
programs they described, rather than clear and eonvUieing, If 
colleges argue that placement rates are inappropriate because 
students are undecided and likely to chaise career plans, they 
may have to present a strong case to students that a career 
planning service integrated into the educational program is 
more essential. 

Some relationships were discovered between self reported 
developmental eharactertstics of students and the information 
which the students viewed* in the abstract, as most essential 
for college choice. These relationships were not, however, 
neccGGarily in the direction which educators might consider 



desirable. For instance, man> studcntii v^ho admitted that the> 
wuuld rvecd avademio help* and who felt leu Ihtin well prcpaied 
for college, seemed likely to choose a college which the> 
perceived to have low academic press rather than one with 
helpful services. Students whose primary reason for attending 
college was social tended to be most interested in the college's 
social environment. In contrast, students who were more aca- 
demically self assured, and whose goals were intellectual, 
seemed likely to look ioz a college with high academic press 
and a high portion of students planning to enter the professions. 
While this is not new information, colleges may want to 
Consider whether the stress on the social en vironment found in 
many eollege catalogs serves to attract tlie type of student in 
which they are most interested. 

The evidence obtained through open^nded responses made 
It vei> elear that students will read additional information into 
eollege descriptions even when great care is taken to assure 
that the descriptions are objective and cautiously limited. In 
making hypothetical choices among colleges, students seemed 
to judge less frequently by the specific tnA)rmatton presented 
than by images they developed of the unidentified college's 
academic or social climate. Furthermore, different students 
arrived at opposite inferences from the same descriptions. 
Some students equated fairly detailed academic policies at 
College A with high academic press* others as evidence of 
potential fair practice, white still others equated explicit policies 
with undesirable rigidity. While colleges have objected to 
presentation of raw statistics on the basis of possible misinter- 
pretation, there is reason to believe that students will mis- 
interpiict material normally found in eollege catalogs — which 
is not dissimilar except in detail and focus from that presented 
in this study. Apparently students look for specific <aitd varying) 
types of information closely related to their goals for attending 
college and their self-perceived characteristics, and they make 
their ehoices on that basis, ignoring other potentially conflicting 
information. Institutions might wish to experiment with de- 
scribing their services throi^h eharactertzations of what actually 
happ<^ns to particular types of students in the educational 
process, rather than presenting average information geared at 
everyone and* therefore, at no one. 

This type of research should be extended to a larger and 
more diverse sample of students with a more tightly controlled 
experimental design to leant more about how student self- 
perceived educational need^, college goals, and information 
supplied by colleges interact. Under present conditions, despite 
federal information mandates, if the student is playing a guess- 
ing game throi^h unwarranted inferences about college op 
porttinittes, he or she is likely to guess wrongjy about as often 
as rightly. 



Footnotes 

Vtopficlary s^htHjt (Icuftpihmv ^^rc ebminatcd for lc^hng purpo^^ hccouv their ilc^nption^ made iheniea.^il> iJcfiiiriabtc 
^Two iirtuT^ high $chQots ^«rc invilcd to paciidratc bul ^clincd be4:au$c of ttni« pressures. 
'^Dclait$ anJ staii^itcs ncH rciponcd ^fc ivatbhk from ttruot Author, 

'*Tbe ftw*rcbers been unat>rc (o cJii wi pmtfam cfuc^ ^ml shtt wkqwtcly ifescfiisc the L^arccf praoning i^t<e$ 
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THE RELATIVE IMPORTANCE OF INITIAL 
STUDENT CHARACTERISTICS AND THE 
FRESHMAN EXPERIENCE OF COLLEGE 
IN VOLUNTARY ATTRITION* 



/ 

,/ 

/ 

/ 

As examination of the attrition resean^h literature will 
reveal* ihe vasTmajority of studies of this type are piimaidly cle- 
scriptive one^, icleniifying correlational relationships between 
attrition and a wide variety of demographic, soctologieal, psy- 
choJogieal, and social P&ychoJogical attributes of students, as 
well as various institutional eharacteristics. Far fewer studies, 
however, proceed from some conceptual statement seeking to 
explain the relationships among these variables and students' 
decisions to withdraw or remain at any given institution. 

Kamens (197 l)theorizc<J (andeollccted evidence indicating) 
that lariger institutions, with their various graduate and profes- 
stonal programs, as well as their broad networb of contacts 
with alumni in the business and professional commumtics, 
offered students greater opponunities for entry into career and 
social positions outside the academic professions than did smaller 
institutionsand would, consequently, generate astronger desire 
among students to remain and take advant^e of these op- 
portunities. 

Rootman (1972) developed an interactional theory, positing 
that student*enviionment "fit" is based on the degree to which 
the student is socialized into the general academic and social 
fabric of an institution and on the degree to which his other 
values and orientations arc shared by the primary peer group. 
Cope and Hannah (1975) also conceive of the sources of 
attrition as being a function of the quality of the student- 
institution "flt.'^ 

The most eomprehensive and explicit theories of attrition 
have been advanced by Spady (I970t 1971) and Tinto (1975), 
both of whom view the degree to which a student is integrated 
into the social and academic systems of an instilutioni and the 
student's interaction with these systems, as the primary deter- 
minants of persistence. Both of these theories specify a role for 
such antecedent attributes as a student's piecollege dispositions, 
interests, attitudes, and skills, as well as the student's interaction 
with environmental characteristics of the institution he or she 
attends* 

Spady* s conceptual i^t ion of attrition liesin the domain of 
social integration, but Tinto theorizes an approximate parity 
between the interaeting tnfluenees of integration in both the 
social and academic systems of an institution. According to 
Tinto: 

Given individual characteristics, prior experiences, and 
commitment, . it is the individual's integration into 
the aeademicand social systems of the college that most 
directly relates to his continuance in that college . . . 
Other things being equalt the higher the (degree of integra- 
tion of the individual into the eollege system, the greater 
will be his commitment to the specific institution and to 
the goal of college competition. (1975, p. 96) 
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We have reponed a study (Terenzini & Pascarella, 1977) 
which tentatively eonflrms the pnnejpal elements of Tinto's 
theory. It was found that variable sets opc rationalizing the two 
concepts of social and academie integration could independently 
differentiate between stayers and voluntary leavers. We also 
found that when two variable sets were entered together into a 
stepwise discriminant analysis^ the relative contributions to the 
separation of the groups by the vanables comprising each set 
indicated that academic and soaal integration were, as Tinto's 
theory specifies, approximately equally imponant. 

That study was limited^ however, by the fact that it was 
cross- sectional and thesamplesize wasnotsuffteiently large to 
include in the main analyses available data on students' back- 
ground eharacteristtes. G)nsequenlly, there was no way of 
knowing whether the stayers and leavers in the study differed at 
the time of matriculation on any of the vanables employed in the 
main part of their a. jlyses. 

The present study has sought to determine the degree to 
which students' behaviors and perceptions of the r^a/jry of their 
college experience could differentiate between students who 
withdrew voluntarily after one year and those who did not. 
This was to be determined after taking into account certain 
possible pre matriculation differences between leavers and 
stayers. 

This study is limited in at least two ways: flrstt subjeets 
have been drawn from a single institution, and second the 
preregistration data for the study did not include such potentially 
important predietois as students' social and economic attributes, 
high school achievement, or precollege commitment to obtaining 
a degree — all of which may influence subsequent patterns of 
social and aeademie integration and tnteraetion. 

Methodology 

Design and sample^ The study, condueted at Syracuse 
University^ was longitudinal and ex post faeto. Syracuse is a 
larger private universuy in centra! New York with a total 
undergraduate enrollment of approximately 10,000 students 
(2,400of whom were freshmen at the time of the study). In July 
l975, a simple random sample^ made up of 1,008 persons who 
had expressed their intention of enrolling in the fall as Syracuse 
freshmen, were sent a questionnaire asking them to report their 
expectations of a variety of aspects of the college experience. 
Usable responses were received from 766 students (76.09&) 
who subsequently enrolled. In March of the following year 
(approximately mid-way through these students' .second semes* 
ter), a second questionnaire was mailed to the same 766 
students seeking information on their perceptions of the reality 
of their college experience. Usuable responses were received 
from 536 freshmen (70.0%; 53.2% of the original sample). Of 
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these 536. however. )92 had incomplete data on one or mc^ of 
the variables used, in the study and. consequently, they were not 
included In the analyses. Thus, the ftncfings reported here are 
based on complete data availabfe for 344 freshmen. Of these 
344. 55 had voluntarily withdrawn from the university at or 
before the end of their freshman year and are identified here as 
leavers. Of the 289 slayers. 1% (approxinutely two-thirdsJ 
were randomly selected for the mam data analyses. Theremain 
ing 93 stayers were withheld from these analyses and, sub^ 
^quently. were used in a partial cross- validation procedure 
described later. Statistical tests indicate that the 344 subjects 
in this study are representative of the Syracuse freshman popu 
lation with respect to sex and college of enrollm£nt. 

Instruments. Ifastudent is fully integrated into the social 
and academic systems of an institution, then, presumably, that 
individual will have more positive perceptions of those two 
dimensions of the instHuttonal environment, participate more 
extensively in extracurricular activities, perform at a higher 
levei of academic achievement, be more committed to obtaining 
adegrce. and be more confident that hisor her decision to attend 
this particular institution was a good one than will a less fully 
integrated student. 

To assess levels of normative integration in the academic 
system of the university, subjects were aslced to indtcate their 
expectations (and later their perceptions) of their academic 
program and how irnpoitant it was to them to graduate (on a 
scale from I = Extremely Important to 4 = Not at All Impor- 
tant). Structural integration in the academic system was indexed 
by a student^'s year<end cumulative grade-point average, an 
indicator specifically identified in the model (Tinlo. p. 92). 

Assessments of subjects' integration in the social system 
of the university were based on students' expectations and 
perceptionsof their nonacademic lives, the number of e^cracur- 
ricular activities in which they expected to spend (and xhc 
number in which they actually didspend) at least two hours per 
week on the average, and the number of times they expected to 
(and did) interact infOfmally with faculty members outside the 
classroom for ten minutes or more. Clearly, informal interaction 
with faculty members may well comprise both academic ^"d 
social dimensions, Tinto adcnowledges that fact (p. 109)^ but he 
nonetheless places interaction with faeulty clearly within the 
social integration portion ot his cOLceptual scheme (p. 95). and. 
for that reason, interaction was treated accordingly in the 
present study. 

Subjects were also asked, as a general index of their 
integration into the institutional systems, to report the level of 
confidence they had that their decision to attend Syracuse 
University was a good one (on a scale from I = Definitely 
Right Choice though 3 = Not Sure to 5 = Definitely Wrong 
Choice). 

As d measure of their expectations (and later x>f their 
perceptions)of their academic program, students were asked to 
rate the statement I (EXPECT/HAVE FOUND) MY ACA* 
DEMIC PROGRAM AT S.U. TO BE on the Adjective Rating 
Scale (ARS) developed by Kelly. Pascarella. Terenzini* and 
Chapman in 1975, The ARS was also used by subjects to 
respond to the statetnent 1 (EXPECT/HAVB FOUND) MY 
NONaCADEMIC life ATS,U. TO Be. The ARS con,<!ists of 
twenty-four adjectives (e.g.. good, enjoyable, demanding, 
boring, useless, practical, interesting) agair^st which dK re- 
spondent rates certain statements by tising a four-point scale 
(I = Extremely. 2 = Very. 3 = Somewhat. 4 = Not at All). 
InfonmtiOn on the reliability and validity of the ARS is 
available tn Kelly et aL 

Additionally* scores were available for the subjects in this 
study on t^lh the quantitative and verbal portions of the 
Scltolastic Aptitude Tests (SATs) and the four areas of Stem's 



(1970) Activities Index (AI). achievement orientation, de- 
pendency needs, emotional expression, andcducability. 

Analysbt Data analysts began with a principal components 
analysis of subjects* ARS "expectations" responses. A similar 
analysis was performed on their ''perceptions** responses. 
Separate analyses were done for each of the four statements 
(two preregist ration, two post-registration). FollowingKai5er*s 
(l959)crilenon. components with eigenvalues greater than I 0 
were extracted and subjected to varimax rotation. The rotated 
components will hereafter be referred to as factors. 

As suggested by Arnior 0974), mean factor scales were 
computed for each respondent by summing the raw scores on 
variables with rotated factor loadings of .40 and above on a 
particular factor and dividing by the number of variables. 
Where a variable loaded above .40 but lower than .50 on two 
dimensions, it was dropped from the computation of factor 
scales. 

Such a procedure may result in the loss of cnhogonality 
and lead to substantial inter-scale correlations. We judged, 
however, that it would be preferahle to optimize the intemal 
consistency reliability of each scale (a product of this scaling 
procedure)} despite the potential loss of orthogonality* since the 
latter situation can be dealt with effectively by employing 
discnminant function analysis which talces the inter -scale cor- 
relations into account. 

To assess differences between the groups, with respect to 
their actual experiences of college, while controlling for any 
initial differences between the twogroups* a multiple regression 
analysis was Hrst performed and residual post-registration vari- 
able scores were computed. Those post-registration variables 
having a counterpart in the pre matriculation data collection 
were regressed on the corresponding preregistration variable, 
the student's sex* academic aptitude (combined SAT score), 
personality characteristics (AI Area scores) aid each parent's 
^{evel of education. Those post- registration variables with no 
jjOunterpart in the preregistration data collection (i.e.. impor- 
tan^^graduation. confidence that the decision toattendS.U. 
was a^qd One* and cumulative grade-point average) were 
regressed on s^, academic aptitude, personality characteristics, 
and parents' levels of education. 

This procedui^nvolved making aprediction of asubject's 
post-registration score^for a given variable, based on that 
subject's initial characteristics and expectations. For each var^ 
iable. (he predicted value ^as subtracted from the observed 
value to obtain aresidual scores In brief, any difTerences found 
bet'iveen the groups on the resi^ualized* post^-registration var- 
iables can not be attributed to initial gtoup differences on any of 
the variables used to calculate the residuals. 

The standardized residuals were tken used as the predictor 
variable scoms-in a two-group stepwise discriminant fuiKtion 
analysis to delennine whether students' actual experience of 
college, independent of their initial characteHstics. could dir 
ferentiate between those who voluntarily witndrew from the 
university after one year and tho^ who contlnVcd into their 
sophomore year* \ 

Finally, a partial cross- validadon procedure, using the 93 
icnown stayers who had not been included in the discriminant 
analysis, was carried out. This procedure serves as a check on 
the discriminating power and stability of the function and as an 
index of the (degree of overlap between the two groups. 

Resnlts _j 
The factor analysis of students' ARS ratings of their 
expected academic programs and expected nonacademic lives 
yielded five factors with eigenvalues greater than 1.0 in both 
instances.The factor analyses of students' actual pcrccptionsof 
their academic programs and nonacademic lives yielded strvc 
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Tabic 1 

Varimax Rotated Factor Loadir^s for 
Smdents" Adjective Rating Scale Responses* 



I expect/have foiind my academic profiram at S,U, 
Factor 



to be: 



1 expect/have foiind my nonacademie Ufe at S.U, to be: 



Factor 
Affective appeal 
Excitir^ 
Er^foyable 
Enlightening 
Stimulating 
Different 
Provocative 

, A[pha fieilabtlity = .83 
^viiriance = 13.52% 

Practical valug 

Valuable 

Worthwhile 

Practical 

Neccssaiy 

InTofmatlvc 

Retev^nt 

Good 

Alpha fiellabifliy .92 
%variancc = 13.8% 

DitHtt£Ss[aparhy 

Borir^ 

Dun 

Inctcvant 

Alpha reliability .80 
% variance = 9.71% 

Difficulty 
DiflG^cult 
Dcmandir^ 
Challen^ng 

Alpha re liability ^ .S7 
= S.I% 

Negative eUmetus 
A waste 
Usctess 
Geneml 

Alpha TCllabiliiy ^ ^67 
% variance = 6.59^ 



Loading Factor 

Affective appeal 

.78 Exciting 

.76 Ei^oyablc 

M Good 

.59 Intc[eMir|$ 

.56 Stimalating 

.40 Enlightening 

Alpha Fcliabili^r = .94 
% variance = 17.98% 

Practical value 
.73 Rctevant 
.65 Practical 
.64 Valuabtc 
.60 WOFlhwhite 
.55 tnfonmative 
.52 Neoessaty 
.42 

Atpha reliability ^ .90 
% variance =12.95% 

Duitnessfapathy 
M Boring 
.72 Dull 
.64 Irrelevant 

Alpha reliability = .98 
% variance ^ 8.41% 

Demam^chailenge 

Demandii^ 
.79 Challcr^lng 
.67 DifHcult 

Alpha reliability = .84 
% variance = 8.12% 

Negative elements 
.73 Useless 
.72 A waste 

47 General 

Alpha fieliabhity = .63 
% variance = 7.61% 



Loadir^ 

.77 
.75 
.72 
.65 
.64 
.58 



.66 
.66 
.61 
.59 
.57 
.47 



.80 
.75 
.58 



.76 
.69 
.66 



.79 
.70 
.56 



Total varianee explained = 51.7% Total variance ^plained = 55.1% 

*Thc compEeic t^or nutriii and related inroimatlofi tac available from the auihors upon request. 



lures whieh were highly simJlarto those obtained in the analyses 
of the expectations data. For this leason^ and in order that the 
pre- and post-rcgistralion data wouM be comparable, the factor 
struclures of students' preregistralion responses to the two 
concepts were used in the computation of factor scale scores 
for both pre- and post-registration responses. 

The compositjotis of the factor structutes for the two 
statements are given in Tabic I . Each factor has been given a 
tentative name which was felt to represent the underlying 
construct tapped. The reader is catttioncdt howcveri against 
attributing surplus meaiiir^ to the factofs beyond the variables 
which characterize them. 

^ Table 1 also shows t^ alpha* or internal consistency 
reitability^ coefficients computed fbr each set of ^tor scales, 
as well as the percentage ofexplained variance accounted for by 
each factor. Because the flfUi factor fbr each analysis had an 



alpha coefflcjent of less than .70, these two factors were 
dropped from all further analyses as insufficiently reliable. 

Table 2 arrays the raw scores and standard deviatiorvs, as 
well as the lesidualized scores atid standajrd deviations for the 
two groups on the thirteen post-registration variables. The 
univariate f-ratios for differences between fRsidualized group 
means on each of the variables are also reported. The multi- 
variate analysis of variance for the thirteen tesidual scores 
yielded anf-rrtio of 4.184 (</./, = 13 and 257), statistically 
significantatp < .OOi.Thecauonicalconelationofthepredic^ 
tor variabfes with group membership was .45. 

For the eight ARS scalestas well as for the importance of 
graduating and sureness SU right choice- variables, a negative 
residual represents morcofagiven attribute than was predicted^ 
whereas a positive residual refTects less. Fbr the number of 
faculty con tactSt number ofextr^urricularactivitiest and grade- 
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Table 2 

Raw Score and Residualized Means and Standard 
Deviations and Univanate T-Ratios^ for 
Residua I ized Scores 



Variable 





Raw scores 




Residualized scores 




Univariate F 


Stayers (n: 


= 196) 


Leavers in 


=55) 


Stayers (n^ 


^196) 


Leavers (n 


-55) 


for 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Residuals^ 


2.58 


.51 


2.94 


.55 


-.01 


.89 


.60 


.95 


19.471*" 


3.25 


.53 


3.22 


.50 


^.06 


.94 


-.08 


.81 


.022 


2.27 


.57 


2.54 


.56 


.02 


.93 


.42 


.90 


8.285" 


2.33 


.60 


2.59 


.65 


-.04 


.90 


.40 


1.00 


9.903" 


1.96 


.68 


2.21 


.72 


^.07 


.91 


.30 


.95 


7.094** 


2.77 


.79 


2.92 


.71 


-.15 


.99 


.12 


.92 


3.390 


1.97 


.60 


2.12 


.67 


-.08 


.90 


.21 


LOO 


4.271* 


3.50 


.66 


3.44 


:52 


.01 


I.IO 


-.08 


.82 


.349 


10.94 


14.92 


4.62 


3.99 


.08 


1.16 


-.39 


.37 


8!7I8** 


2.00 


4.53 


1.14 


2.91 


.04 


1.15 


-.11 


.75 


.888 


2.80 


.64 


2.65 


.71 


-.02 


.89 


-.20 


.98 


1.739 


1.34 


.63 


1.65 


.91 


-.08 


.91 


.38 


1.32 


8.849** 


2.17 


.97 


2.82 


1.35 


-.08 ■ 


.91 


.57 


1.26 


17.768*** 



Affeciive appeal (Academic program) 
Dullnesis/apaihy (Academic program) 
Practical Appeal (Academic program) 

faculty/challenge (Academic program) 
AfTccitve ap])eal (Nonacademic life) 
Diffictilty/diallenge (Nonacademic life) 
Piractical appeal (Nonacademic \\(6) 
Dullness/apaihy {Nonacademic life) 
No* of contacts with faculty 
No. of exiracumcularaciivities 
Cumulative grade-point average 
Imponance or gradual ii^ 
Sureikcss SU r|ghi choice 



^Degrees of fiwdom fl- Jand248. 

Note. The ARS is scored from I - Extremely to 4 = U<A at All. Ttiusi on the affective appeal factors for e;iamp1e, lower scores are more positive. 
Similarly, a lower ^coie on bothihe importance ofgraduat'ng and suiencss SU nght choice scales is more positive than a higher one. 



*p < .05 



**p < .01 



*P < .001 



point average, the reverse is true. This curious situation is a 
function of the meaning of the scale units and the method of 
calculating residuals. 

Table 3 shows the order in which the thirteen predictor 
variableseniercdth!^ analysis, the amount ofchange in Rao's V 
statistic attributable toeach (aii index of the incremental contij- 
button to group sep4ration made by a variable when it enters* 
given those variables already in the analysis), and the standard- 
ized discriminant weights. These weights* which indicate a 
given' variable's relative contribution to group separation, and 
the amount of chapge in Rao's V were used in making judgments 
about which variables were the niost important in separating the 
two groups. 



These indices suggest that the amouni of affective appeal 
and dullriesVapathy respondents found in their academic pro- 
grams were the two largest contributors to ihe discrimination 
between the groups, stayers reporting both more eniotional 
attractiveness and less dullness in their academic pvogxams than 
leavers. These two variables were followed closely in importance 
by a respondent's confidence that his or her decision to attend 
SU was a good one and by the amount of reported informal 
contact with faculty members outside the classroom. 

Interestingly^ and perhaps revealingly, neither cumulative 
grack-point average nor any oftlie social integration variables 
mack significant contributions to jeparatlng the groups af^er 
taking into account a respondent's sex, academic aptitude. 



TaWe3 

Results of Stepwise Discriminant Analysis 
of Residualized Scores 



Standardized 







Chatige in 


discriminant 


Step 


Variable entered 


' Rao*sV" 


weight 


1 


Affeciive appeal {Academic pnogram) 


19.47*** 


-.51 


2 


Sutcikcss SU right choice 


7.91** 


-.41 


3 


Dullness/apathy (Academic program) 


12.02*** 


-.50 


4 


No. of coTKacts with ^liy 


7.00** 


.37 


5 


Importance of graduatii^ 


3.89* 


-.24 


6 


Di^culty/chalkngc {Academic program) 


3.15 


-.25 


7 


AfTecttve appeal (Nonacadcmie life) 


1.64 


-.23 


8 


Cumulative gradc*point average 


.99 


.13 


, 9 


Practical appeal (Nonacademic life) 


.33 


.10 


io 


Practical appeal (Academic program) 
Difficully/chollenge <Nonacademic hTc) 


.24 


.10 


H 


.21 


-.07 


12 


Oullitcss/apathy (Nonacademic life) 


.18 


.06 


13 


No. of c^itraciirncular activities 


.10 


.04 



^Indicates tncnnKntAlcontributfun to discn min«tM>n. given (hose vtriabki already in the analysis. 
*p < .05 **p < .01 ***p < .001 
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pcnonalily characteristics* anJ parcnK' leveh of cJu*.fttion, 
The results of the classification analysis show that 74 
percent of (he stayers. 64 percent of the leavers, and 73 percent 
of the partial cross valuation sta^eri (v^UhhcId from the majn 
analysis) were correctly clossifed. In (he case of the cross- 
validation group, chance alone should result m the ^orrest 
classification of half of the cases, the 73 percent correctly clas:^! 
{led represents a significant improvement on chance <; ,001). 
While this finding indicates moderate siibllit> inthefunchon>ii 
also represents (as does the moderate canomcaJ LOnelation) that 
somc'overJap gxits between the two groups, 

DjSCuSSlon\ 

A numb<?i of student background characteristics presumably 
mediate the degree to v^hich the student becomes socially and 
academically integrated into the institution. Tinto theorized 
that* **Other thingtt being equal, the higher the degree of 
integration the grater will be <the) commitment to the 
specific institution and to the goaJ of cojlegc t jmpletion" 
(p. 96). 

In a test of Tinto *s theory ^ and after initial differences due 
to sex, academic aptitude, personality charactenstic^, parents' 
education and pre registration expectations had been statistically 
controlled* stayers in th^s study^as compared with leavers, 
ra'fed their academic programs higher on a factor labeled afTcc- 
tive appeal and lov^er on a factor termed dullness/apdthy . They 
also reported more fh;qucnt contact with faculty memberb 
ouBtde the classroom and had more Confidence that their 
decision to attend Syracuse University was 9 g{>od one. 

Although Tinto*smodel gives approximately equal weight 
to students' background characteristics and their interaction 
witji the institution's social and academic systems* the findings 
of this study suggest that what happens to a student after he or she 
matriculates may have at least as great an mfluence (if not a 
greater influence) on subsequent attrition- related decisions as 
mitial expectations* personality characteristics, or academic 
aptitude A preliminary multivariate analysis of variance of 
leaversandstaycrs was done with respect to academic aptitude, 
personality characteristics^ pre matriculation expectations of 
their academic programs and nonaeademic Jives* expected num- 
ber of informal contacts with faculty, and the number of extra- 
curricular activities in which the students would engage. The 
resulting F ratio ( 639. with d.f. = 15/235) was nonsignifi- 
cant, indicating no differences between the groups with respect 
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to these initial attnbute^. Nor did any univartaie analyses of 
variance on the^ variables indicate significant differences. 

It may be, particularly at larger institutions such as the one 
in this study, that tf a student cdn find what Stem (1970Halled 
an ecological niche* then the Iiktihood of that student s be- 
coming integrated into institutional social and academic systems, 
and of remainmg at the mstitutton* may be substantially in- 
crea^d, [f this isso* then mitial student character) sttcb may be 
more important in the dynamics of attrition at sniallennstuutions, 
where the sj^tety of niches from whxchafreshmanmay choose 
is more limited than it is at larger schools, 

Tinto also theorized that social and academic integration 
are approximately equally important in studenEs' attrition de- 
cisions, and Terenzini and Pascarella (1977) reported evidence 
supporting this conceptual equaJity, The results of the current 
study » howcven indicate that academic dimensions may be 
more mflueijtial than social considerations in students' decisions 
to remain or withdraw voluntarily. Of the four primary dis- 
criminators in this study> the two most important ones (affective 
appeal and dull ness/apathy of the academic program) related to 
academic matters; of the other two, one (sureness SU was the 
right choice) was an Indicator of general integration, and the 
other (amount of informal contact with faculty) might be argued 
to influence both social and academicintegrationJndeed. Tinto 
(p, ]09) acknowledges such a dual role for student- faculty 
interaction, and our earlier study 0976) *ieported evidence 
supporting such a di)uble influence by faculty interattion. 
Moreover^ non; of the four dinncnstons of students perceptions 
of their nonaeademic lives, nor the number of extracumcular 
activities in which they engaged^ made a significant contribu- 
tion to ai^rimination between the groups. 

It ispossiblet of coursct that the opportunities and mechan- 
isms for facilitating the assimilation of freshmen into this 
institution's sociai system are quite adequate » yielding rev^ards 
sufficient to make social maladaptation an insignificant factor 
in freshman attrition at this university. Whether this is* in fact, 
the case — and whether the conceptual equality in importance of 
social and academic integration* as Tmto theorized^ obtains at a 
cross- institutional level— can only be determined through addi^ 
tional research. 

As previously noted, this study is limited by the fact that it 
wasconducted on a single campus. The applicability of Tinto's 
theory for researching (and reducing) attrition on other campuses 
remains to be tested by subsequent studies in different scttmgs» 
but the results of thts study suggest the theory has merit. 
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THE USEFULNESS OF ADMINISTRATIVE 
PLANNING AND MANAGEMENT INFORMATION 
FOR PROSPECnVE STUDENTS 



Mosl posUccondary instiluttons have a large vanet> of 
what might be called administl^tive planriing and managcincnt 
information in vanOus orfices across the eampus (e.g.. in the 
admissions, alumni, business, dean's, finaneial aids, institu- 
tional research, ptaccment> registnir's and residence halts of- 
fices) The Better Infoimation for^tudent Choice of G)llcge 
project of the National Center for Higher Education Manage- 
ment Systems (NCHEMS) was basea^^n the premise that some 
of tht« infonnation (which is typicallji used for purposes such 
as institutional and departmental plannW, policy formulatioiit 
and decision making, and which has ott^i not been c<^nsidcred 
for use by students in their decision making) could be U^ful to 
p'^ospeclivc students as they make thcir¥hoices concerning 
irha' postsecondary institution to attend. Omer premises of the 
project were that such information would ivc^ to be transrerred 
into a different fonn in order to f>e really u^fbl to students. 

Pro^iect staff worked with various gioa^ of people in 
different contexts to identif)' relevant informa^on that could 
aid students in their choice of a pOJttseconda^ institution. 
Included were: admissions personncU cOun selling center per* 
sonnclf institutional research personnel* other ad'ninistratorSr 
faculty members, timfcr students, graduate student^ minority 
students of different kinds, older students, sophomore students 
who enrolled out of high sehool, and other student ^ups at 
a selected group of colleges representing different t^^pes of 
postscconciary Institutions, high school seniors in tl^c process 
of choosing a college, high school guidance counselors, and 
parents of high school students and college sophomores who 
entered out of college. 

Personnel and students from I S postsecondary institutions 
and over ISO high schools participated in one or more phases 
of the pix)ject Five of the postsecondary institutions^ each 
representing a* type of college and being located in different 
parts of the country, participated in all phases of the projects 
from early planning to the end.' A total of Z^ZOZ out of the 
7,815 diverse people contacted (42%) responded to the formal 
needs assessment questionnaire (several hundit^ others having 
previously responded to early drafU of the questionnaires to try 
them out and suggest changes), and over SOQ relevant people 
were fonnally interviewed during the piX)ject. In addition, 384 
college Treshmcn at Ihc five colleges participated in a pre- 
liminary survey which concerned the contnbution of different 
presentation formats to undt:rstanding and the case with which 
institotional comparisions can be made for particular types of 
information* 

Developing and Administering the Needs 
Assessment Questionnaire 

The initial weeks of the piX)jcct involved loosely structured 
interviews conducted with students, counselors, and oihcr 
personnel at four quite different high schools (one small rural, 
one suburban, one inner-city, and one Catholic urban) and 
three colleges (one public commuter university, one community 
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College, and one Catholic liberal ans college) in the £>enver 
area. The interviewee^^ were asked what qucstion^k needed to be 
aiiswcrcd for a piX)Spectiv^ college student tocffectively choose 
an institution to attend, what specitte items of information 
would help answer the various questions* what infoimation 
needed that postsecondary institutions were not providing, and 
what items of information were being provided but were in- 
adequate in content and/or form. Based or hese interviews, a 
review of the lilerature in the college cho e area, a review of 
data-gathering questionnaires commonly utilized at colleges, 
and a r icw of lists of college data base items available at 
NCHEMS, the staff prepared, where possible need was indi- 
cated, a pool of roogh-draft items in questionnaire fomtat. 
!deas meaningfully related to one another were included in the 
same printed item to show such a relationship. This bothered 
some psychometrically oriented NCHEMS stafr people who 
reviewed them, siitcc one principle of psychometrics is to have 
only one idea in a single item. However^ it served well in this 
early stage for facilitating economy and transition in subse- 
quent interviews. 

Next, project campus coordinators for the five major 
participating colleges met over a period of iwo days with .he 
project staff. The staff presented the preliminary work that 
had been donc^and it was critiqued by the campus coordinators. 
Each institution agreed to choose students at random for 
each of a number of special student groups to participate in the 
needs assessment stirvey. In addition, plans were made for 
further development of the needs assessment survcj^ question- 
naire, three- to fivc^ay visits by an NCHEMS two-man team 
to each campus, and for adminisieniig the qttestionnaire. Bvery 
campus was to be provided with the tequcsied numbers of each 
form of the questionnaire, and each campus was to administer 
the <luestionnaire at its own cxpcnse,^ using the methods best 
for it. (Administration guidelines to insure validit> and reliabil* 
ity were outlined* however.) Each institution was to choose 20 
diverse high schools that were its m^or feeders and wntc them 
to "pave the way/' Then, NCHEMS would conduct the 
survey of high school counselors, students* and parents. Be- 
cause of the Buckley Amendment, the colleges were to survey 
the parents for their sample of sophomore students. 

At the meeting, the coordinators provided suggestions to 
assist development of a pilot test question naire for the project 
and agreed to get further input about items from their campuses. 
At the same timc> the project staff tried out the rough-draft 
items c^n counselors and students at the E)envcr*area institutions 
referred ^ previously. In addition, later versions of the ques* 
tk>nnaire were sent to some earlier interviewees who had 
expressed an interest in helping in this way, and they were then 
phoned for their reactions and suggestions regarxling the items 
and formats The project staff also solicited suggestions from 
the entire NCHEMS staff (in addition to a small group that had 
been involved all along in a reactive and consultative role), 
from the fund members of the Fund for the Improvement of 
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Poslsecondar^ Education (FIP5E) National Task Force on 
Belter Inromiation for Student Choice^ and from a elasa of 
graduate dudcnti in mcasuiement at the University of Colorado. 
Based on all of the pieliminafy input* and after going through 
seven separate drafts, a coltcge-wide and an iniendcil-major (in- 
tended program |of study) ^orm of a questionnaire for eollege 
undergraduates and high school students was developed for 
piJot ted purposes. Jt was discovered that many of the items 
mentioned about institutions were also mentioned about eur- 
ncular programs! and when asked about it, most people thought 
it would be useful toobserve the relationship of the prograjTi to 
the ''institution jas a whole" on the same item (e.g.* grading 
slnetness) and comparc this to the same relationship for another^ 
institution, using the same program there. The questionnaire 
item wording aiid stnieture ware improved markedly to make 
the items more understandable and meanii^fiil to both high 
school and eollege students (some eompromisas had to be 
made in ordet to have a form useful for both groups). The 
items that everyone agreed to be unimportant were eliminated^ 
and the hems of information that everyone s^re^d were beir^ 
provided adequately by eolleges were also deJcted. 

In early drafts, the staff had planned to ask two questions 
about each inrormatk>n item: <a) its imponancc for seleetir^ a 
eollege and (b) whether or not college"! were currently sup>)lying 
this information and if so, whether in an adequate manner. 
E^Iiminary tryout indicated that a two coJum format (for two 
responses to eaeh item) had the following problems, it was too 
eomple\ for many students* numerous students tended to answer 
the same in both eolumns for the same item (which suggested 
a possible response set)* and it made the time required to 
eonipteic the questionruire too lengthy. Therefore, since g^K>d 
interview evidence had been obtained from a variety of groups 
that the items remaining were inadequate in some respect for 
most coJIeges, the inquiry was limited to importance to the 
college selection process. 

Next, the ptJot test qvestionnatres were critiqued orally 
during extensive interviews eondueled by the two project staff 
with personnel and students at the five panieipaiir^ colleges 
during three- to five-day visits to eaeh eampus. The r .mbcr of 
people interviewed ranged from 25 at Seattle Paeifie College 
to over 130 at Central State University. The interview sample 
had been determined by the pA>jeeteo<ndinator for eaeh eampus. 
At Drake a d Central StatCi the staff also talked to counselors 
from feeder community colleges and hfgh schools. Scaiile 
Pacific had them interview a cOupJe of youth pastors in a local 
church of their denominatiens Valencia scheduled an interview 
with a liaison person who was interaetir^ with area high 
schools on a fulMimc basis. 

In addition to die campus interviews, eaeh pan'cif^atiiig 
college ran a pilot test of the questionnaire with a jjv*f.c 
group of its students Funher modifications to the fiudcnt 
questionnaires were made based on input from thc^' ^da>in^ 
istering the questionnaires, from analyzing questionnaire a..^ 
SwerSt and from an analysis of student r£actk>ns and suggestions 
written on the completed questionnaires. 

Modifieatk>n5 were also made based on returns from a 
pilot test conducted by the projcci staff at ten diverse high 
schools throughout the state of Colorado. Arrangements were 
made by phone with Ihe principal at each achool for the 
school's counseling ^tafT* as a group* to complete a pilot test 
high school counselor form of the questionnaire that had been 
constructed based on the interview inputs described previously. 
In addition, ten sludentSt representative of the diversity of the 
students^ were to complete the two student Versions of the 
questionnaire (five students to take eaeh questionnaire). In 
addition to identifying response data from completed question- 
natrest follow'tip phone calls were made to the schools to see if 



there had been any problems and to obtain suggestions for ihe 
high sehool part of the upcoming questionnaire survey. Since 
Educational Opportunity Program (EOP; counselors had re- 
poncd that high school counselors generally pointed them 
toward white and high ability students^ even when others were 
requested, several schools with high proportions of minontes 
were purposely chosen. The EOP cortientiOn was supported to 
some extent. 

Based on the pilot test results and all of the interview 
data* eight different forms orafinat survey questionnaire were 
developed, (a) a student questionnaire focusing on college- 
wide information needs, (b) a student questionnaire foci^ing on 
the needs for information about particular programs of study at 
the colleges being considered, (cj a high school counselor 
questionnaire focusing on the student needs for information 
perceived by counselors, (d) a gradjate student form of the 
quest io.m aire focusing on the perceived needs for mformaiion 
in choosjr^g a graduate schooi, (c) a transfer student form of 
the questionnaire focusmg on the need for collegc-widc in* 
formation in choosing a college lo which to transfer, as com- 
pared to choosing an initial coJlcgc* (C a transfer student form 
of.the questionnaire focusingon the need for program*of-study 
information in choosing a college to which to transfer, as 
compared to choosing an initiaJ college* {g^ a parent quesUon- 
naire focusing on collcge-widc information needs, and {h) a 
parent quc^ionnsurc focusing on program -of- study information 
needs. EacL /orm of the questionnaire was printed on a differcm 
color of paper lO faciliate administration and collection. 

Institutions participating in the National Task Force on 
Better Information for Student Choice were invttcd to partici- 
pate in the NCHEMS need, .issessment survey, aiid three task 
force institutions took advantage of this offer. Maeomb Com- 
munity College counselors visited each of about two dozen 
area high schools and administered questionnaires to their 
counselors and groups of their students and parents. The 
University of California at Irvine administered the questionnaire 
to various groups of thei: students and to high schooJ students, 
counsclois, and parents. [\)nland State University admimstcrcd 
the questionnaire to counselors throughout Oregon and Wasli- 
ington. 

It had been hoped that one of the proprietary institutions , 
on the task force would want to participate in the survey^ but 
their energies were beingtakenup with their own local projects* 
Therefore, Armstrong CoUge* a proprietary institution in 
Berkeley, California, whose dean had wnticn asking for in- 
formation about the projects was asked to partiapatc. Arm* 
strong College accepted and administered both the college- 
wide and CO I lege program forms to 100 of its students. 

The five other colleges each selected 20 of their feeder high 
schools for the sitrveyt forwarded names and addresses of 
principals to NCHEMf and wrote the principals informing 
them of the upcoming NCHEMS contact. (The pantcipating 
task force colleges who desired to have surveys of high school 
samples were to conduct th^irown high sehool surveys j The 
central project staff then sent to the 100 principals typed 
letters, one counsefor form, and ten sets of student/parent 
forms. In eaeh letter^ the eollege that had recommended them 
as a high school *'lhat would be wilting to help out'' was 
mentioned. Several schools in each group having many mfrnonty 
students were asked to include only minonty students in the 
survey, based on the pilot test experience. Each of five of the 
student/parent sets included a college -wide information ques- 
tionnaire for students, and one for parcntSt stapled to a eovor 
sheet that had a short message for the student and a short 
message for the parents. Each of the other five siudent/parcnt 
sets included colic go-major questionnaires of both Xinds stapled 
to Another cover sheet. 



220 

204 



Lenntng and Cooper 



The principals vierc requested to have their eounseijrs 
complete the counselor form as a group. They were also asked 
to select ten senior students cunently in the process of choo^irtg 
a college and to give each of them a questionnaire set to la)ce 
home— where they and their parents would independently 
complete their respective questionnaires (after which they coutd 
compare answers, if they desire<l). When the counselors* ques- 
tionnaire and at least si\ of the student/parent s^ts were com- 
pleted, the principal was to return them to NCHEMS in the 
preaddressed and stamped envelope. The letter also pix)mised 
to provide the principals with rcsuhs of the high school portion 
of the study after it was completed. 

Since New England was not represented at all tn any 
group of the project, and, eonsidering the feeling of some that 
New England students might be unique, NCHBMS obtained 
names and addresses of five high school principals in Vermont 
who, it was thought* would be willing to cooperate with the 
project, and makings were also made to them. 

A serious problem oecurred with high schools in metro- 
politan areas when the project staff starte<l receiving letters ~ 
from high schools saying that their districts would not allow 
them to participate in outside surveys that iiad not been approved 
by the district research office. The campus coordinators were 
asked to check with lar]ge sehool distiiets in their areas, and 
they foudd that the problem was quite extensive. In almost 
every case, the policies were recently enacted, whteh meant 
that the local colleges did not yet know about them. Further^ 
more, none of the schools had replied to the letters from the 
colleges to let them know about the problem, so both NCHEMS 
and the colleges had erroneously assumed that everything was 
satisfactory With the help of the eampus coordinators, the 
proper district forms were completed and submitted. Approval 
as obtained in almost every case (one refusal beir^ an appan^nt 
political problem where they were afraid to even hint at extra 
work of any kind for school staffs). 

Results of the Needs Assessment Survey 

In addition to the overall analyses^ separate analyses for 
each i^f the nine , rticipating colleges Were done as folk)ws. 
(a) separately for each student subgroup on their campus that 
had at least 25 respondents, (b) for the parents of dieir sopho- 
more group if there were at Jeasl 25 respondents, and (c) for 
the students and parents associated with their feeder high 
school*:. Eaeh participating sehool was provided by NCHEMS 
with the following, staff summaries of the total study results, 
computer printout for their g|X)ups of respondents, puneh cards 
for all of their respondents, which they could use for additional 
analyses for their campus (baekground data coltet;ted on each 
student questionnaire making a number of different analyses 
feasible^ and an NCHEMS-preparcdsummaiy report discussing 
the major findings fof.their local campus and how they com- 
pared lo the results for all partieipating colleges for those 
groups* ^ 

In order to reduce costs and response bias, it was decided 
thati rather than distribute a large number of questionnaires to 
each survey s^'^ple, participating colleges would select only 
50 students a^ random for each oftheir subgroups and continue 
followiog up until a 60 percent response rate was reached. This 
would result in 30 respondents for each group, whieh is the 
number needed for assurance that there will be stability for 
means, percentages* and simple statistical tests, assuming that 
the samples were caiefbUy selecti^d using random procedures. 
Except for several baste groups ihiU almost everyone examined, 
the response rate goa! was not reached, and most groups at 
each college had n counts that were too low to have their 
responses analyzed separately for that college. Interestingly, 
the response rates for the high school samples (54 percent 



average) tended to be much higher thai, the response rates for 
the college samples (35 pereent average). 

For all colleges combined, a total of ^9 of the 64 eollege- 
widc items were rated very important by a majority of the 
respondents in two or more of the groups. An additional 17 of 
tt:e items were rated Important Or higher by the majonty of 
respondents in most of the groups. The responses to items on 
both the college-major and eellege-wide forms were quite 
similar, even though the forms asked about the need for 
information from the perspec of the (intended) college pro^ 
gram in the first ease and eollegc-wide general information in 
the latter Overall, items were rated slightly less important by 
those taking the college-major forms.^ 

The most important area of information was the section. 
Information about Instruction and Instructors. This included 
items on **the way classes aie taught . . . , descriptions of the 
instructors . . . , class sizes,** ete. The items of highest im- 
portance were the issues of transferability of eourses to other 
institutions, the minimum number of courses in the college 
major required for graduation, the minimum number of courses 
outside of the college major require((-for gfaduation, and the 
time at whieh a student must declare a major field of study if 
he or she ts to graduate on time. Other important clusters of 
items included college impaet on last year* s graduates, admis- 
sions information, financial aid Information, and generab in- 
formation (availability, cost, and student ratings of different 
kinds of housing, the specific goals and objectives of the college 
or program; students' descriptions of the general atmosphere at 
the college, student input to college decision making, and 
evidence of financial soundness of the college or program). 
Items dealing with information about students (age,^ cultural 
background, etc) were rated the poorest The parents of high 
school students and parents of college students were consistent 
in their ratings of items, with no significant differences ap- 
parent in their responses to the 61 college-major items or the 
64 college-wide itenis. 

Concerning ^e differences, older students tended, to see 
more of a need for pro^^ram information, white younger students 
tended to see more of a need for college^wide information. 
Interestingly, of the older students* those 45 years and older 
tended to answer differently than those less than ^5 years old. 
they seemed to need less specific information and were more 
conservative in their responses ^sticking more to the middle of 
the scale). 

Transfer students answered similarly to undergraduate 
sophon[K>res concerning their initial choice of college but wanted 
more specific information concerning a Cf^llege to which to 
transfer Surprisingly* the graduate student responses concern- 
ing choice of a graduate school were similar to those of the 
under^graduate students concerning choice of an undergraduate 
school, except for expected differences such as housing. 

The njinority groups tended to rate all information as 
morv important than did the overall sample. They also tended 
to be much more concerned than others (and this especially 
came out in the interview£)^bout student body characteristics. 
The interviews also indicated some very special concerns — 
sueh as racial/ethnic eomposition of the faculty, whether there 
wer3 black (or Indian or Chicano) organizations on campus, 
and how active they were, whether Ihere Was a blaek studies 
program, etc. Although the Indian and Chieano samples were 
not large enough to draw valid conclusions, there were indica- 
tions that the three racial groups were answerit.^ quite flif* 
ferently on some of the items. Also, a number of m* . rity 
students, as well as Educational Opportunity Program \tDP) 
counselors, reported that characteristic and experience profiles 
of the total student body were not very helpful to them. They 
apparently need separate profiles by race of student character' 
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isticsr how students adjust and achieve, and their experiences 
on the campus. 

Afler the study was completed* a special report of the 
needs assessment findings^ that utflired a quest ion -and -answer 
lovmu was sent to the 105 high schools to which NCHEMS 
had sent survey rorms, along with the list of the 29 items that 
had E?een rated highest by most groups. That report has some 
additional findings that may be of interest to the reader. It is 
available at cost from NCHEMS. 

The project staff also made follow-up phone calls to 
selected people (from various groups) who had provided phone 
numbers on ttieir tjuestionnaircs and had indicated they would 
be interested in being eoiitacted for clanfication about why 
they had answeticd ^ they did and \^hat their perceptions of 
need were. AHer about two dozen calls» no new iiifonnation 
had been attained (comments just confinning what had been 
found in the interviews during ^he ftrst few months of the 
project)* so additional calls were not ma(ic. 

AvallahllUy, Accuracy, and Willingness to Release Data 

During the on-campus interviews* the project staff talked 
to institutional leseaichers and other relevant staff about the 
availability and aceuracy of the infonnation being suggested 
for prospeetive students as well as the feasibility of being 
able to collect it if it was not already available. Except for 
outcome information and student ratings of various kinds, 
most of the information was available at the five colleges. 
Additional coneem was expressed at one of the institutions 
abotit' some of the information being available but not in 
machine-readable form. In legard to accuracy, tlieie was con- 
cern about the fact that often different definitions are used in 
jdifTercnt colleges for the same index. For example* some 
institutions include athletic scholarships in financial aid* while 
others do not. 

The staff abo talked to the presidents and other poliey 
makers at the five colleges about their willingness to release 
such data to prospective students. In general no one saw any 
problem with releasing information as long as proper precau- 
tions were taken to put it into context in order to keep it from 
being misleading. One exception was a president who s£,ld 
''information is power** and must be handled with great care. 
He said he eould spea)c to this question only afler he saw how 
the specific information was to he presented. 

After the overall needs as^ment analyses were com- 
pleted, an availability-of-data survey questionnaire and a 
willingness- to-releasc-<Iata survey questionnaire were devel- 
opcdt focusing separately on the 29 items ra'^ especially 
important in the needs assessment survey. One eopy of eaeh 
questionnaire was sent to each of the five eampus coordinators 
who Were asked to have appropriate eampus personnel answer 
them. They were to bring them along and dlscu;^ them at the 
final eampus coordinators meeting with central^ project staff. 
Once again* the survey results confirmed the interview results: 
all five institutions had available the needed information* 
except for outcomes information and student ratings. All five 
campuses expressed a wilHngness to teleasc the various itcrns 
of information as long as care was taken in its presentation. 
Sevefdl campuses expressed concern* however^ about releasing 
financial-aid- by *famiiy*ineonDC data and instructor rating^. They 
tliought stieh ttata cou)^ easily be misinterpreted by students. 

It should b^ kept in mind that these were only five 
eollegest which were chosen because they have more planning 
and management information than the typical college, in addi- 
tion to a special interest in better infonnation. For example, at 
one of the other colleges visited initially, the instltuo'onal 
people seemed fear^td of releasing much of the infonnation to 
prospective students. Funhermorct they said that mueh of it 



was not even available and could not be collected withont 
outside finaneial help. They did not have a director of insitu- 
tional research. 

Conclusion 

Only a small number of postsecondary institutions were 
involved in this study (nine in the survey and si>c others in the 
early interview phases)* and the total samples at each college 
Were selected to be diverse rather than representative of the 
student body at the college. Fuithermote^ the high schools, 
except for a few, were all feeder high schools to the participa- 
ting colleges. Yet^ several thousand diverse incfividuals re- 
spondedr and the patterns seemed to make sense. In addition* 
the results were consistent* from college to college^ with the 
expectea differences (e.g.r students considering the church- 
related college were mor- interested in information about 
religious activities on campus than were students considering 
the other colleges). 

The results suggest veiy strongly that much administrative 
planning and man agementi in formation is useful to prospective 
^students in ma)cing a choice of college. All major groups used 
in the study, including counselors and parents* agreed that 
. .such information was needed and was often not provided* or 
provided inadequately* to P^pective students. Furthermore* 
it seems clear that some of the major subgroups of students 
applying to campuses have special needs for information aboul* 
the institutions and their programs. And^ if one agrees with 
Clark* Celatt* and Levine (1965) that '^although thejise of 
relevant information by ro means guarantees the 'right' de- 
cision, 'good* decision making cannotoccurwithoui it'* <p. 47)* 
it might be expected that the effective communication of 
such information will also benefit colleges and universities. 
For example* happier and more satisfied students might be 
expected to lead to higher student body nwrale, lower attrition^ 
and more positive re{>ons to friends back in h^h school and to 
relatives* factors which should also afTect recmitmcnt. 

Additional information about the items in the survey 
questionnaires for this study, and what they mean* is provided 
by Lenning and Cooper <in piess). They Jso give procedures 
and suggestions for needs assessment studies in this area and 
discuss considerations and effeetive procedur^*^ for communi- 
cating Information to prospective students. 

Preliminary (lata presented from -the later survey in the 
project indicate that tables of tabulations may be the most 
effective means of communicating much of this type of in- 
formation. (See Ijcnning & Cooper.) In that survey* institu- 
tional data for 12 of the 29 most important items were presented 
separately for two fictitious colleges (College A and College 
B), using five different formats: (a) tables of tabulated statistics* 
(b) tabulation as in / with the addition of a relevant cartoon or 
carkaturcr (c) script paragraphs* (d) questions and ansv/ers* 
and (c) charts; and graphs. A total of 369 incoming freshmen at 
the five colleges responded to the alternative presentations for 
eaeh item separately in terms of two critsria. '"which way of 
presenting this type of information Is most understandable and 
meaningful toyott*' and *'in which way of presenting this type 
of information is it easier to compare College A and College 
B?*' Tables of tabulations (Altemative No. I) were ehoscn as 
being most meaningful f(^ 9 of the 12 items and asmost useful 
in making comparisons for 8 pf the 12 Items. (This finding 
might logically be expected not to apply if tabulations arc 
over*used* although data in the survey do not pertain at all to 
this (question.) Thus, the data may not have to be reformatted 
for use by students nearly as much as had been anticipated. 
Conversclyt the same 369 diverse new freshmen . Hvc quite 
dtfTcrent colleges consistently rated script paragraphs (the for* 
mat of vno&i college catalogs and other publications) as the 
least effective of the five presentation formats. 
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Footnotes 

^Thcse itistituttoni wtn. Central Slate Uji/v<i3iiy jn Oklahoma* XhsAut tJnive/siiy* Seaixle pKific CoWt^t Ihc Univcrsjl> of CoLotmIo at BouUtCT* and Valencia 
Commtijiiiy Coltegc in Flodda. 

^odcd mean tange profites for ihe iomtMn^ i:oJlege undergraduate gtoap and six other nujor gnnip of respondents are available tiotn NCHEMS at ^on for both the 
(■ ^c^'jvide and cottcge-m^or fonni of the quciiioanaire. Item tabulations and rankmgi for selected groups aiealso available. 
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ASSSSSiNG DIMENSIONS OF QUALHT 

IN DOCTORAL EDUCATION; A REPORT ON 

RECENT RESEARCH 

Mary Jo Clark 
Educational Testing Serricc 

This research surveyed advanced jpraduate siudents> facuh^ 
members who ^each graduate students, and recent alumni (torn 
doctoral programs in chanistry* history* and psychology at 25 
npresentative American universitiesyto measure program per- 
fortt^^nce in a var^ty of quality- related areas. The resujting 
ind;ces wen evaluated in relation to one another and to factual 
infofmation about the resources and structure of the programs. 
Differences h program purpose <to train researchers, college 
teachers* or other kinds .of professional praetitioners) were 
explored in addition to differences and similarities in disei- 
pUne^ size> and setting. A profile of departmental seores on 
s^leeted indiees illustrates a program's perfonnance in relation 
to other programs with simitar purposes in the same discipline. 
Possibie uses and users of the iihfonnation are explored, and 
method^ to improve the assessment of graduate programs are-^ 
recommended. 

ANTICIPATORY SOCIALIZATION 
OF GRADUATE STUDENTS 

J/jmes L* Be^s 

Teachers Colkgef Cotwtibia University 

The majesty of college and university faculty have nar- 
row and traditional views of the objectives of education and of 
the modes by which they can be achieved. In part, these 
attitudes can be traced to the nature of the occupational ir;iage 
attached to the academic profession and to the kinds of persons 
who are attracted to it. An equally important influence on 
faculty orientations toward their roles^. however^ is the social- 
ization process which takes place in graduate school. Typicallyi 
the processes of professional molding engender a relatively 
conservative unifonnity of attitudes among students. More- 
dver, any proclivities toward change and innovation whf^h 
students bring with them at the start of graduate school tend to 
be dampened or eliminated. 

^ Theresearch findings leported^n this paper compare new 
graduate students prior to initial anival at a catffi^slWlh 
faculty ntembers already employed then. The data indicant, 
that begiiming graduate students andcipate ahat, as faculty > 
men^rSf they will prefer to teach more, try out new teaching 
tceliniqtfest subject themselves to collegtal ahd peer evalua- 
tioHf work wilh students ^o have special learning difficuliieSf 
and interact with students informally to contribute to their 
growth and development. Further^ new graduate students ex- 
press stro^cr preferences for admiiiistrative and community 
service, Rndings also reveal diffepeiiccUtl^rsonali^ by field 
and the relationship of both tojwcferted acSviti^. ^ y 



FACULTY VIEWS OF EDUCATIONAL PURPOSE 
AND PROCESS; AN INTERINSTITUTIONAL STUDY 
OF LIBERAL ARTS FACULTY 

Joan $. Stark 
Syracuse University 
Barry R. Morstain 
University of Deiaware 

Since faculty play a pivotal role in developing academic 
programs and policies* their views toward education ma}^havc 
a major influence on the adaptability or responsiveness of an 
institution to evolving educational needs and priorities. 
Faculty views have seldom been systematically explored. 

Faculty at six private liberal arts eollege^were asked to 
complete the Faculty Orientations Survey <POS)> a recently 
developed research inventory. The instnintent consists of 56 
Likcrt-type items tappii^ faculty opinion on the nature and 
pmpose of a college education* preferred teaching- la ming 
arrangements* and student involvement in educational decision 
making. Of 3^ faculty at the six colleges, 2^7 completed the 
FOS for a response rate olf 72%* ^ 

A principal components factor analysis performed on the 
data led to identification^of ioculty attitude dimensions. Items 
from the invenjprywere aggregated to form factor scales; 
estimates-of scale reliability (coefficient alpha) were substan- 
tial. Analyses of variance using the factor scate scof^ data 
indicated that there are more commonalities than differences in 
faculty educational orientations across diverse liberal arts col- 
leges. However, examinst:ion of attitudes expressed by faculty 
grouped by curriculum atea, academic rank» time devoted to 
research/scholarship* years of teaching experience^ etc. sug- 
gest that faculty do differ substantively in their educational 
views and orientation. 

COMMUNITY SURVEY; DISCOVERING THE 
IDENTIFIED COMMUNITY NEEDS 
FOR ADMINISTRATIVE PLANNING AND 
DECISION MAKING 

Roger Andersen 
Dale R, Reed 

Allegany Community College^ Maryland 

The main purpose of the research was to determine and 
assess community feedback eonceming the Allegany Com- 
nrjanily College in order to detcnnine the awareness, the per- 
ceptions, and the needs of this population in ngard to the 
college. A four percent random sample of the county's rcsi* 
dential telephone population was utilized^^ the study*s^ample 
with a telephone §prvey technique employed^ Students served 
I as callers for the study and were trained ih^t^o evening 
sessic^iT^ that included a special manual prepared (ox this sur^ 
vey along withsimukition exercises. All 20 items of the survey 
were subjected to and location breakdowns. Result^ 
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showed respondents feel lhal Ihe college is doing a very good 
Job in serving the communily and thai (he two major reasons 
that participants wouJd continue their education at the eolltege 
were its location and Jow cost. However, a majority/ of the 
lesponJents overestimated the semester tuitiom the^stuJent 
body enrollment, and the age of the student body. Inis indi- 
cated a Jaiige degree of community misconception and 'a lack of 
awareness regarding the coUege. Other results indicate the 
types of medi. 'hat the community utilizes and to w}^t degree, 
opinions concerning program expansion and the possibility of 
establishing credit extension centers, and reasons^or not en- 
^rolling in courses of the college. ^ ! 

NONINTELLECTIVE PHEOIGTORS 

OF STUDENl* PERSISTENCE/ ATTRITION 

AND PERFORMANCE 

WilUam F. Bramel 
bmversity of Connecticut 

This paper reports design^ methodology^ and findings of 
three studies representative of types of data institutional re- 
searchers might generate for college and university manage- 
ment i^fomiation systems where predictors of student attrition 
and performance have value. 

Nearly half of all American college students leave collie 
before graduation and 85% do so for nonintellectivc reasons. 
Attrition inc^^eases program costs and decreases faculty pro- 
ductivity. Efforts to increase degreed stocks of women and 
minorities entail considerable investment in support ahd sup- 
port services. Addressing the nbnintellectivc factors impact- 
ing on students assumes a high priority in both of these 
instances. Administrators of expensive^ high- investment pro- 
grams arc also concerned that their graduates perform well on 
the labor market. 

Traditional predictor variables of SAT scores and high 
school grades seldom account for more than 25% of the Vari- 
ance in student performance in college, and they account for 
even less in decisions of students leave school/The studies 
'n this paper added non intellective variables to tfils combina- 
tion and increased the amount of variance accounted for signi- 
ficantly. 

The studFes involved pre(fiction of academic performance, 
persistence/attrition, and job performance of sti:denls in a 
health careers program^ picdiciion of college enrollment and 
performance of students in a high school en riclvnent program, 
for needy students (many of whom were members of rainority 
groups), and prediction of status as a college administrator for 
women college studcn^. Birth order, interests^ socio- 
economic status and early adolescent school experiences were 
identified as useful predictors in all or some of the stucfies. 
Step-wise regression analysis, analysts of variance, and mul- 
tiple analysis of variance constituted the main statistical 
applications. 

AN EXPLORATION OF GRADE INFLATION 
AND SOME RELATED FACTORS IN 
HIGHER EDUCATION 

Paul Carney 

Richard L, hakson ^ 

Randy EUsworth 

Wichitn State University * 

This research documented grade inflation at Wichita State 
University between 1965 and 1975. The development of a 



more restrictive definition of grade inflation at the university 
level involving student aptitude as'wd! as student grades 
strengthened the discovery of thji» phenomenon at Wichita 
State Uni^^ersity. The present study also documented grade 
inflation within the university's College of Education between 
1968 and 1^6. Flirther study of this phenomenon within the 
College of Etiueation uncomcd differing pattems of inflation 
in graduate and undergraduate grades. This study's attempt to 
identify faetors related to grade inflation was perhaps its most 
important eontribution. Three faetors possibly related to grade 
inflation were identified: the increased use of eriterion- 
referenced grading by university faeulty; the use of student 
evaluation in faeulty salary, tenure, and promotion decisions; 
and an expansion of experience -oriented courses. One other 
factor investigated^ the increased use of incompletes and with- 
drawals by students to protect their grade point averages, w^ 
found to be unrelated to grade inflation. In connectioo with 
this research » a (|uestionnatre was developed to assess the 
attitudes of the current faculty within the Colte^^fMication 
toward grading and grade inflation. The que;stionnairc provided 
further ioformatton concerning the jpajbr criteria used in 
grading and the major factors contributing to grade inflation as 
seen by responding membersjof the faculty. , ^ 

FACULTY ACCEPTANCE OF WORK-LOAD SURVEYS 

John W. Cresweli 

William i. Davis 

Oklahoma State University 

Gerald H,,K/amer 

Pittsburg State University^ Kansas 

Reports issued from the Faculty Activity Analysis ^A A) 
project sponsored by. the National Center For Higher Educa- 
tion .Management Systems (NCKEMS) have recently summar- 
ized the issues that "face those who design faeulty activity 
aitalysis surveys. These work-load surveys have assessed 
faculty effort in activities such as teaching, research and pro- 
fessional service. In some instances^ they have contribute to 
multiditnensional con trovetsies among faeulty, administrators, 
and external control groups over the appropriate "professional 
life" of the academic. Interestingly enough, research studies 
have failed to examine faculty reactions to the collection of the 
activity data* although NCKEMS has raised several hypo- 
theses about factors that are related to faculty acceptance. 

This research ^tudy empirically tested three NCKEMS 
hypotheses at one lai^ge midwestem university. Faculty -ix the 
university completed a questionnaire that assessed their atti- 
tude toward the work-load survey administered at the institu* 
tion and independent variables suggested by NCKEMS. (a) the 
degree to whichfaeulty felt they were a strong governing force 
in the institution, (b) the degree to which faculty felt that 
survey data could Itelp promote their departments, and (c) the 
number of years that the faeulty had completed the survey. A 
soctopsychological perspective of acceptance based ^ the 
academic as a professional, as suggested by Etzioni and f^ar- 
sons, and the academic as a worker, advanced by Arygris, was 
used as an explanatory framewoik for the research hypotheses. 
The findings showed that faeulty tend to accept a work-load 
survey if it has relevance for them in the department, but 
^'^ acceptance appeared to have little relationship to facuhy auton- 
omy and years of completing the instrument. Implications for 
administrative planners are to involve departmental faculty in 
the design of work-load surveys and to carefully assess how 
the department uses survey data. 
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UNDERSTANDING COSTING METH0D0L0G1£S 

Wittiam C. Crotkers \ 
Vniversity of WSsconsin-Stoia 
Thc/jtas Freeman \ i 
Michigan State University \ ; 

Tt^e costing melhodology employed is an important com- 
ponent to understand as wc worK with the eost data in poliey 
Tormaticin and finaneial analysis; too often it is the eost that 
is the fodal point rather than ho^Mt^ra^ derived* what it means, 
and how it can be utilized in decistUn making. 

There arc three hasie options Tor allocating eosts to 
courses. These may be categorized as managed costst manipu- 
lated proxy eostsi and aetual costs. Managed costs aie built 
from an assignment base. They approach true or victual cost to 
the degree that the departmental ehairpcrson knows the faeulty 
memt^r*s work load in detail and is able to report his 
assignment to various funetions aecoidingly. This varies 
greatly with the size of the departments the eon^lexity of the 
fqcuhyfunetions, the complexity of the instruetk>nal modeJtthe 
relationship between the ehairpcrson and the faeulty mcinbert 
and the administrative demands on the ehairpcrson's time. 

The manipulated eosts use proxies for allocating eosts to 
courses in an attempt to approach the reality of actual faeulty 
work-foad distribut'On. A study eOmparing the results using 
ihtCc proxies is reported in this paper. 

The actual cost of instruction is related to the salary paid 
the professor and how he allocates his time to variou:; functions 
including instruction. One of the most efficient methods for 
determining how the faeuJty allocates time to instmction is a 
Faculty Activity Analysis (FAA). Ttjjs paper includes a report 
On a study conducted at Miehfgan State University eomparing 
different eosting methodologies. 

WHEN THE SUM OF THE PARTS DOESN*T EQUAL 
T^ WHOLE; A BUDGET PLANNING SYSTEM 
FOE MISAGGHEGATED DATA 

Jt4ait G, Garcia 
University of Massachusetts 
Rohm T. Lewis 

Georgia Institute of Technology - ^ 

Jn spite of the development of new budget planning 
methodologies in recent years, many institutions of higher 
education eontinue to restrict the time span encompassed in 
their fiscal plans to a period ranging from the reeent past to 
perhaps one or two ]^ears into ihe future. One problem to 
eonsider in shifting the planning horizon from short-range to 
medium^ and long-^nge planning ts the level at which data is 
enterc<I into the planning information system. Some organiza- 
tional units or programmatie areas of an institution generate 
fiscal plans in great detailf^while others plan in aggregate at 
higher levels. However* most information systems require that 
all data be entered at one specifie level which is determined 
beforehand^ The relationship between data entry level and 
planning horizon varies sharply in the region from one to five 
years on the planning hprizon. As thcplanning horizon range is 
shortettcdt there is a eorrcsponding decrease In the data entry 
range. Conversely, airihe planning horizon ralige is lengthened* 
the data entry range increases. An information system designer 
can capitalize on this charaeteristie by developing a system 
whleh permits the data entry level to vary with the planning 
honzon and organi rational level or prc^rammatie area.^The 
lower data entry levels will more likely occur in the near future 



and the higher d.ita entry levels in the distant future. Sueh a 
system allows flexibility in the entry of future fiseal plans at 
dissimilarlevels;itpermit5 the planner tj selec (hat JeveJwhieh 
is most apprc^riate to the task and r<:;a at hanJ. 

DATA SYSTEMS DESIGN—A MODEL FOR 
DECISION MAKING 

Barry Greenberg 

Nancy L Goodwin 

Florida Internatioital University 

In this presentation* a data systems approaeh to the 
decision -matting process is presented as a means of increasing 
its effectiveness and offleieney. 

Institutional research oflficcs are aeeustomed to receiving 
requests for accurate data and data analyses which must be 
handled within a narrow, range of time. There are several 
problems which need to be overcome.in order for IR offices to 
fulfill this funetion. These eenter around the fact that most 
operating data systems within a university are not designcd^to- 
supply data for decision making within a shortperiod oftime. 

The location of a demand terminarwithin an offlee of 
institutional research makes it possible to overcome the£C 
diffleulties. Such a confrguration at Florida Intcmatiomil 
j.UniversIty has led to signifieant inereases in the ability of the 
ofinee U) handle present requests and. most importantly, in the 
ability df the office to do the developmental work neee^'sary for 
improving all data systems.^ 

in the presentation, examples of the^pes of data systems 
and data repods whieh have t^en generated In support of the 
decision -making process are highlighted. Specifle issues in 
^ short- and long-range planning and in budgetary analyses are 
raised and an explanationof how data was deri%^ to consider 
those issues ts discussed. 

The theme of the preseijtation is that systems* suehias the 
one prescnied^are imperative if institutional research is ever to 
develop some independenee from"" the operational systems ; 
whieh' impact the daily operation of the university. 

APPROACHES TO CROSS-UNIT COMPARISONS IN 
MEASURING THE EFFECTIVENESS OF ACADEMIC 
SUPPORT PROGRAMS 

Harvey K, Jacobson / 

Ttie Utiiversity of Michigan ^ 

The past decade has seen an upsurge of interest in social 
measurement. Social aceounting has emerged as a eritical part 
of planning in higher education because of public disenchant- 
ment with higher ediieation. troublesome economic strin- 
gcncier>, and wide diffusion of cost^analytic techniques. Top- 
level management increasingly seeks measurement, informa* 
tion* and reporting systems for planning, implementation, and 
evaluation. As budget pressures increase, the evaluation 
process shiHs its focus from academic programs to support 
systems such as libraries and public relations and developnfient 
units. 

It becomes more and more important to interpret in rather 
precise terms the level of p^ormance of Support systems andto 
make comparisons between system^*. The concept of effective- 
ness ncedsgreater clarification in terms of scicntifiCf technical 
social, poJitical* and economic definition. A review of 
conceptuaiization and measurement for support systems indi- 
cates that progress has been achieved with minimal cross* 
system interest. This paper examines approaches that hoI<^ 
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promise for cfo^^-uait a^i^imilation and application and ad- 
VftntCk d kOiiLeptual context ^^c^^ment based vn vjcv^mg 
th\university as an infonnation-proccssing oi^anization. 

appIkYing formative and SUMMATIVE 

EVALtJATION STRATEGIES FOR MANAGING 
INTENDED OUTCOMES OF INSTITUTIONAL 
RESEARCH AND PLANNING 

Etame S. Jhjftrs 

University of Maryiand-Bosttm Shore 

Institutional research and planning must havcjmvrgamza 
tional riame^orkforongoingasscssm^toTirs outcomes. This 
paper illustrates s^levted^aJtcnmdve fbnnative and summativC 
evaluationtj^hniques which can be used to accomplish this 
..^rposc. Ibvaluation procedures demonstrated for improving 
institutional management and ongoing assessment of outcomes 
Consist of utilizing.. (I) the CIPP (Context, Input, Process, 
Product) Model and the Fbrtune-Hutchinscm Model (University 
of Mass^husetts) as techniques for momplishing fonnaiive 
and summative evaluation of the data-base management proc- 
ess, (2) a systems nfiodel for organizing a structure for awm 
phshing fonnative and summative evaluation of institutional 
outcomes, and (3) mint systems models Tor or^ganizing a 
structure for, accomplishing formative evaluation of planning 
done by special programs and administrative units. R^ults of 
. illustrating the above techniqties indicate the following con- 
clusions. (J) the formative evaluation strategies upgrade 
institutional research and planning operations by offering 
altemative structures for periodically assessing the quality and 
progress of implemented efforts, (2) that summative evaluation 
strategies upgrade institutional research and planning opera- 
tions by offering possible solutions forjudging the complete- 
ness and sufficiency of implemented efforts. 

A FRAMEWORK FOR ANALYSIS OF JOINT 
PRODUCTION COSTS IN THE MEDICAL EDUCATION 
PROCESS 

P. Jolly. Jr. . 
Association of American Medical Colleges 
K. U Kutina 

Case Western Reserve University 

As rn some industnaJ processes, many activities in higher 
education lead simultaneously to the product^n of multiple 
outputs. This phenomenon is prevalent in medical education 
becau&e much of the instruction is necessarily earned on in the 
course of delivery of medical care. This joint production of 
Outputs from a single indivisible activity also occurs ^Hh 
university -based research programs^hich incorporate graduate 
students. Such activities contribute to the production of both 
new knowledge and graduate education. 

Although one ean often detennine the total Cost of an 
activity from which multiple outputs are pioduced, detennina- 
tton of a unique cost ascribable to each product is, in principle, 
impossible. However, it is extrentely importaitt for analysts of 
higher education to work toward developing rational ap- 
proaches to analyzing the costs of programmatic outputs from 
joint activities. Such activities can comprise signifleant 
portions of a university faculty's activities. In the School of 
Medicine ot CuSC Western Reserve University (CWRU), 
studies have indicated that about 45 percent of the faculty's 
acttvitles yield joint outputs, representing over $8^000,000 of 
expci\se< 

The authors present an analytical framework for deter- 
mining a limited range of values over which costs of a joint 
dttivity arc oscribahle to given Outputs. Guidelines for choosing 



specific values within the ranges arc also proposed The 
methodology illustrated using tu,tudl d^la from studies at the 
CWRU School of Medicine. 

A MODEL FOR DETERMINING INEQUALITY 
OF OPPORTUNITY IN PUBLIC INSTITUTIONS 
OF HIGHER EDUCATION - ^ 

HiihardC. Leventhai^^^^^^'^^^ 
University q^^nvef"^ 

'^'^ Amerjcaii higher education today is faced with the 
problem of providing foi greater access by a lariger number of 
persons to institutions of higher education. The Carnegie 
Commission has used such terms as equality of npponunity. 
access, and choice m describing the task of providing 
increasing numbers of individuals the opportunity fo^ higher 
education. 

Choice may be said to be affected by tt..ee sets of factors: 
(I) the aspirations of ihe individual sAident, (2) personal 
factors, and (3) institufipnal and state policies. 

In studying these three factors, we may observe that if a 
student decides to attend a public college or university and 
applies for admission to such an institution (this maybe viewed 
as the aspirations of the student), then thepersonalas well as the 
institutional and state policies may actually become barriers to 
entr;^nce. Thus, whether an individual's choice of a particular 
institution becomes a reality will be affected by the personal 
factors of the student's ability and financial resources and the 
institution a Land state policies on budgeting, allocation, and 
method for admitting students as well as on awarding financial 
aid and size of award. 

A major assumption of this study is that if it is socially 
desirable to maximize choieevf Ihe individual student, then the 
state should attempt to remove whatever barriers exist. This 
study focuses on the barriers to choice which are dependent 
upon Stat;; policies; ti is significant not only to identify these 
potential bamers but also the policies which i;ifluence these 
barriers;' with the hope that policies can be changed to reduce or 
eliminate them. 

OLDER STUDENTS— HOW DIFFERENT ARE THEY? 

John A. Muffo 

University of Illinois ar Urbana^Champaign 

The study^ investigated the ways in which older students 
differ from younger ones with regard to their achievements, 
aspirations, and satisfactions. Achievement variables included 
academic perfonnanCe and mode of admission, while aspira; 
tions were measured by academic majors and degree and career 
plans. Satisfaction variables focused on various academic and 
nonacaderntc aspects of the College. The study was limited in 
scope to a random sample of new students enrolled at 
Metropolitan State College, Denver, G)lorado during the fall 
quarter of 1974. 

The results of the study show that older and younger 
students, as well as men and ^women, do differ somewhat 
concerning achievements^ aspirations, and satisfactions, but 
they do not differ to the extent implied by much of the Current 
literature. Academic achievements vary according to age and 
sex, but the variance is due primarily to differences of sex and 
mode of admission* not to age alone. Major choice as a measure 
of aspirations differed initially, yet afiter one year, older and 
younger students had selected similar m^rs, their academic 
and career aspirations were likewise similar. The two gtoups 
showed no significant difference of C*)int0n as to level of 
satisfactions With the Institution. 

In general, the study found that, among the type of 
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students studied, significant differences do sometimes exWt 
between older and younger students* but these diffetvnces afc 
attributable to age Only to the extent that age interacts with other 
variables to yield these results. 

A SYSTEM FOR DEPARTMENTAL EVALUATION 
FOR PROMOTION^ TENURE AND ASSIGNMENTS 

Vnivtrsite de Moncion 

The pmposc of the paper is to present and describe aniodel 
for the evaluation of facuhy in colleges and universities for 
purposes of promotion, tenure, and assignments. Following a 
recent study of evaluation practices in several institutions m 
Canada, the United Slates, Europe, and Austratia* the author 
has developed a systematic model following sotmd evaluation 
principles which re fleets actual practices. The paper outlines in 
some detail the ten components of the model. 

A TH1RD*GENERATI0NSTUDENT 
INSTRUCrrONAL RATING SYSTEM 

URoy A. Olson 
Michigan State University 

The academic governance stnicturc of Michigan State 
iJntversity (MSU) has adopted a three-level Student fnstnic- 
tional Rating System (SIRS) which rccogni^ three functions 
qS student ratings: fec<iback to instructors for purposes of 
improving instruction, information for adminiMr;tiors to atJ m 
making decisions rcgardii^ faculty, and information to hdp 
students select courses and instructors. 

SfRS Level I wasde^igned to reflect the points in the MSU 
Code of Teaching: Responsibility, a document >e fleeting 
minimun^l expectations for faculty membcrs^ Activities covered 
in the code include statement of course 0bJeelTves» meeting 
clasSt holding office hours^ and soon. Responses to ihc level- 1 
formare ttsed^at the ttniversity level, itt making administrative 
decisions concerning promotion, retention, and so On. Responses 
to Jtenis on clarity of objectives and convenience of office 
hours, for example^ provide faculty members with feedback 
useful for the improvement of instruction. 

SJRS Level 2' is direetJy ori en tc«i^ toward feedback to 
instructors for the improvement of instruction. Bach teaching 
unit is responsible for the deveJopment of itsown feveJ^2 form. 
Many teaching units have developed forms whose items reflect 
the particular objectives of that unit. For example, the 
Dcpamnent of American Thought and Language form includes 
items On reading and writing, areas of specific concem to that 
department. Levcl-2 forms adopted by teaching units probably 
contain rattier general items in order to gain ttie consensus of 
Unit faculty and wiJI be necessarily followed up by more 
specific questiOTis Level^2 responses arc afso use<l in making 
administrative decisions at (he teaching-unit level. 

SfRS Level 3 is designed to provide students with 
infonnation on other students' reactions to help them select 
ini;truetOrs and courses. The form is dcveJoped by a committee 
composed of student members of the Academic Council and 
' ^^pproved by a majority of the student members of the council. 
Ad minis tratbu of level-3 forms is voluntary'^ the discretion of 
the instnieton smee the results are published. 

The thTce-level SfRS has several major advantages. First, it 
allows students (0 respond to forms in terms of the use of the 
results* Seconds the new SIRS authorizes and encourages the 
deveJopment of forms tb meet the specific needs of each 
teaching department. Third, the University^ wide form is based 
on a specific reference — in this case* the Code of Teaching 
Rtffponsibility. 



AN INVESTIGATION INTO THESOCIAL STRUCTURE 
ASPECT OF BALDRIDGE'S POLITICAL MODEL AT 
A SMALL LIBERAL ARTS COLLEGE 

Douglas R, Power 
LeMoyne College 

Responses to the Institutional Goals Uiventory were 
elicited from random samples of a total of S37 Mudcnts, alumm» 
parents, administrators, faculty^and trustees at a private Jiberal 
arts college to gather perception^ of and preferences for 
institutional goals in an attempt to verify empirically the social 
structure aspea of a political model of govemance. 

The following null hypotheses were posed which were 
. designed to test for significant differences in the ^vay respond- 
ents perceive goals and the goals they would prefer: 
H^: There will be no significant differences In perceptions 
of current .institutional goals between the iniemal 
constituent group and the extcmpj eonstiment group. 
H^: There will be no significant differences in preferences 
for institutional goals between the iniemal constituent 
< 1 group and the external constituent group. 

H^: There will be no sigQificant differences in perceptions 
of current institutional goals for each possible pairwise 
comjjarison of constituent groups. 
H^: There will be no significant differences in preferences 
for institutional goals for cach^ possible pairwise 
comparison of constituent groups. 
Three-hundrcu ninety-two responses were retumed and 
analyzed using multf)le group discnm in ant function analysis to 
test for the stgnificance of the differences among the vanotis 
constituent groups related to percepttons of, and preferences 
for. institutional goals and to select those goals which 
discriminated between thc^' various groups. 

Based on the data collected and analyzed, each of the null 
hypotheses was rejected indicating that there were significant 
differences relating to perceptions of and preferences for 
institutional goals among the various constituent groups. 

REVIEWING FACULTYSALARIES 
FOR CONSISTENCY 

Gerald W. McLaughltn 
John C. Smart 
W- Kevin Hunt 
J. R. Montgomery . 

Virginia Polytechnic Institute and State University 

A major activity in academic and institutional administra- 
tion is planning for and allocating dollars to faculty salaries. As 
with any organization, institutions need to insure that their 
salaries are consistent both internally ^nd with comparable 
institutions. This resolves to a basic quef tion of, What factors 
explain faculty salaries?Once thisbasicquestion is determined » 
administrators catt more easily evaluate the faculty salary 
structure at their institutions for both intemal and external 
consistency and plan for needed changes. This research 
develops a model for determining the direct and indirect effect 
of institutional and faculty characfcrislics on salaries of l\ill- 
time teaching faculty. The analysis is done^ using path 
coefficients and a six-stage model. 

The variables in each stage arc nneasurcd as follows: 
Stage /. Institutional characteristics: Carnegie type* region. 

predominate race/sex, public or private control, and 
community size 
Stage 2. Personal characteristics: Age, sex, race, highest 

degree^ curriculum^ yeani experience 
Stage Personal productivity: Days for professional activi- 
ties, articles publishcdv books « manuals or mono- 
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gmphs wntten, puNicationS in fast ivvo years, 
research funds 

Stage 4^ Institutional recognition. Tenure, rank* yem since 
promotion 

Stag^ 5* Duties. HourbatlministFation* hours teaching* hourb 

advising* hours research, number of classes 
Stage 6. SaJaiy: Current instituttonaJ saJaiy. 

The use of path coeffietents provides measures of the 
relative inftuenee of the direct and indirect effect of the 
independent meastifcs on salary. 

s 

AN ANALYTICAL MODEL AND APPROACH 
FOR DESCRIBING AND IMPROVING AN 
INSTITUTION'S MANAGEMENT PROCESS: 
THROUGH A DECISION IMPLEMENTATION 
SYSTEM STRUCTURE ANALYSIS (DISSA) PROFILE 

David S,Spence \ 
United Board for CoHege Deveiopinent 
Danny A. Joslyn 

Interdenm*'.' '^onal Theoiogicai Center 

The purpose of management in a college is lo ensure that - 
important outcomes are attained — Outcomes thatsfulfiJI the 
mission of the institution. WhiJc the purpose of management is 
to ensure that certain goal outcomes are met* the heart of 
management lies in making many kinds of choiees at>out 
alternative activities on a daily basis. Therefore, tnc first step in 
improving management invUlves identifying those decision- 
making and implementation activities that take place. To 
facilitate this aspect of improvement, three dimensions are 
explored: (1) participation — who and in what manner, (2) 
inforfiiatlon used in various steps of decision making and 
implementation* and (3). selection criteria— factors used to 
assess altemative actions. 

These dimcnsionsareanalyifed in terms oft wcnty outcome 
areas as they relate to evaluation <past performance)* budgeting 
(current to one-year activities), and planning (activities 2-5 
years hence)^ . 

Profile I — Participation. This profile identifies persons 
who participate m U) the definition of the problem faced, (b) the 
suggestions of alternative ways to solve the probfemt (e) the 
choice of what cnteria will be used in choosing an altemative, 
and (d) final selection of a single altemative. 

Profile It — Informotion ased. Infonnation is needed for 
each decision to define the problem in tenns of (a) theobjcctivcs 
to be reached and the current prctgress toward these objectives 
and (b) and assessment of the effects (outcomes) of the sug- 
gested alternatives. 

Profile lll^eleuton criteria. While eawh altemative will 
supposedly solve the problem by closing the gap between the 
real and ideal objective outcomes, a decision must be made to 
detennine which altcmativcs Will be given priority. The factors 
UM^d are other outcomes that might be gcncrdtetl through 
implementation of an altemative. This profile documents 
alternative cf^oices by additional outcomes that may be 
generated. 

THC DEgiSION-MAKING PROCESS OFCOMMUNITY 
COLLEGE TRUSTEES 

Eugene J- SuUmn 

American Council on Education 

Franks. Pesci 

Loyola College /" 

The main pmpjsc of this study was to obtain an 
understanding of the decision-makmg process of community 
college boards of trustees. 



Empirical data werecollcctcd and analyzed concerning the 
interactional, decision -making behaviors of thrcl^ boards of 
trustces^from three different geographical settings—urban, 
suburban* and rural, in one state. The data were collected by 
means of (a) an observational method devised by Bales to study 
small-group behavior and (b) a questionnaire which was based 
on the twelve observational categories used in the Bales 
method. 

The analysis of the data produced the following findings: 
(I) community college boards have different proportions of 
task-oriented and social-em otionai aets for routine* or pro^. 
grammcd, decisions than for creative, or nonprogrammed, 
decisions, <2) more programmed decisions are made than 
nonprogrammed ones* (3) community college presidents and 
trustees have different roles in the decision-making procesSt {^) 
the most influential persons in the decision making are the 
board chaiiperson, the vice-chaiiperson* and the president, 
the president being the most dominant, particularly in regard 
to control of information, (5) there are no diffetences in 
the decision- making processes of community college boards of 
trustees in urban, suburban, and rural settings* (6) trustees are 
not satisfied with their role of supporting proposals mad^ by the 
president and would like to assume a more active and 
questioning role. 

Among the recommendations made as a result of this study 
are the following: (I) revision of current board practices to 
allow for mone meaningful trustee participation in decision 
making and (2) replication of this study for four-year college 
and university boards of trustees. 

DO THEY GO WHERE THEY CAME FROM— A STUDY 
OF THE GRADUATES OF A COLLEGE OF MEDICINE 

John C. Wolff, Jr. 
University of Kentucky 

The present study, in part a replication of 1970 findings* 
confirmed thatgraduatesof the University of Kentucky (Allege 
of Medicine (UKMO^who were originally from Appalachian^ 
Kentucky were more likely to piaetice in that medically 
underservcd area than were graduates who entered the UKMC 
from anywhere else. 

Study findingsalso included evidence that graduates from 
rural counties in Kentucky were more likely to practice in 
Kentucky than were graduates from urban counties. Graduates 
who chose family/general practice chose Kentucky practice 
more frequently than graduates in other medical specialties 

No major differences were found between urban and rural 
graduates in their choice of rctu ming lo the same county or Area 
Development District from whkh they entered. No differences 
were found.in these same choices among graduates who chose 
selected medical ^specialties. 

Admitting Appalachian students ta meet the medical 
manpower needs of Appalachian Kentucky was recommended 
Also recommended were admitting rural students and encour- 
aging more students to select family pr^icticc as methods of 
meeting the medical manpower needs of the Commonwealth of 
Kentucky. , 

PECKING ORDERS: US£S AND LIMITATIONS 

S. Godwin Wong 

University of California. San Francisco 

In an effort to rank and rate programs and institutions in 
some pecking order, smdies of various kinds have been 
conducted. Results of such comparative studies have of^cn been 
quoted^ misquoted, used, and misused in a variety of settings 
and for different purposes. 
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Most of the rankings claim to reflect an evaluation of the 
quality* reputation, and prestige of the programs. The myth of 
the elitist eoncept is intriguing, Whjie cankitlg of any sort is 
inexaet, many of the studies were rigorous research projects of 
interest to 'institutional planners and researchers. 

However, many of the pecking orders do not represent an 
assessment of quality The relativdstandiagofaninstitut;o]ior 
program depends upon many faetors — the quaJifieations and 
Commitment of the faculty^ size of the llbraiy eolleetion, 
financial resources^ ability of the students li attracts, the 
academic and physical environment of the institution, its 
organizational structure, performance of its graduates, and so 
on* A closer Jook at the studies is useful. 

This paper examines, classifies, and categorizes the 
tanking and rating studies by field, type^ scope and methodol- 
ogy^ Such elassificafion is important in undemanding the 
validity and possible usage ofthe results. The potential uses and 
the advantages of tising the results from such studies are 
discussed, while the Eimitations and pitfalls of these pecking 
orders arc also addressed. Possible future directions in research 
in this area arc explored. 



A PLANNING SYSTEMS MODEL OF COST ANALYSIS 

David J. Zaumeyer 
RicHurdT. Wines 
St, John's University 

The re^^arch rcponed in this paper deals with the 
development of a conceptual framework intended to provide an 
understanding of the use of cost models in decision -making 
processes in ediK:ation, A planning systems model is offeic<l 
describing relationships between decision makers wjio require 
information and analysts who Supply information based on 
perceived needs, U is a way of viewing the development of 
decision -making information which suggests not only what 
data might be sought but also on >^hat criteria those data might 
be considered useful foC planning and budgeting purposes. 

The model itself is composed of three interrelated systems: 
a deeision*niaking system, a model -building system, and a 
mod^l system. Each component is described, and inlcrrelatioti- 
ships among the components are detailed. The result.is a totally 
integrated model which places the search for factual infonna- 
tion in perspective with the organizational, environmental, and 
public-]K)licy dimensions of the ti^ of cost nfiodeJs tn decision 
making. 

The model described draws on systems theory, organiza* 
tion theory, and economtes and attempts to provide a 
comprehensive perspective of decision-making and related 
information needs. Because ofthe authors' heavy involvenfient 
in the design of cost models it) medical education, the model is 
illustrated using health professionals education as the referent 
system, Howevert the franficwork i^ perceived apptieable to 
other program structures in higher e(^eation, 

INSTRUCTIONAL MARKETIW 

Deforest L (Woody) Trautman 
John J, Fomof ' 
Patsy F. Scott 
The University of Toledo 

O^ campuses today the officer of institutional research, 
academtc studies or matiagement information plays several 
roIcs: projector of enrollments, follow-up founter of student 
work load, worner of the tmplieatiotls of potential enrollment 
shifts, and sometimes as instigator of new program initiatives, 

\ 



To aid the fulfillment of prophecy, this ofBcer may also 
informally address the issues and actions of what may be 
descriptively termed "instructional marketing," 

Continuing fulHime student cnroUmctlts fluctuate widely, 
and targ^ swings in the no\v prominent part-time enrollment 
occur for unforeseen scheduling or program reasons. The 
profound changes in both clients and programs of the 
instnietionat marketplace suggest refocusing of data collection 
and its presentation to provide adequate understanding of 
problems and to stimulate appropriate combined administrative 
and academic decisions. Profile data, for example, might 
inclufie a basic cross-tabulation unit of sex/age/ethmcUy/ 
majWfull-part/undeigrad-grad/suburban/non-local. and of 
moming/al^ernoon/evcning/weekend sche<luling preference, A 
program "broker" would h&lp each academic unit translate the 
findings of instructional marketing into its own new offerings. 

This paper discusses the applications at the Umversity of 
Toledo, indicates the new data, the decision and brokerage 
functions which^ have emerged, and presents a pceliminary 
appraisal of results, 

THE (JSES OF SURVEYS.OF GRADCATES (OUTCOME 
STUDIES) FOR ACCOUNTABILITY AND ACADEMIC 
PLANNIW ' 

Raiph B, Henard 

University of Colorado-Denver ' 

Surveys of graduates provided information about each 
offered degree program that was used for reports to slate 
committees, other governmental agencies, and accrediting 
associations, Managenfient information for academic planning, 
accountability* and resource allocations was obtained from the 
data. Examples of information resulting from surveys of 
graduates at a large mu hi -campus university and a medium- 
sized urban campus are as follows: 

i' Mo^t frequently mentioned Purposes for obtaining 
degrees were the following: (a) occupational preparation and 
advancement (baccalaureates— 61 percent^ advanced <iegrer 
recipients — 76 percent), and (b). general education (bacca- 
laureates — 20 percent, advanced degree recipients — 19 percent). 

2, Ttie first employment after receiving the degree was 
directly or indirectly related to the academic field of study 
(baccalaureates— 70 percent, advanced degree recipients— 91 
percent), 

3» Only 3,7 percent of the 1 970-75 graduates arc 
unemployed, 

4, The degree was helpful (a) in obtaining employmenC" 
.(80 percent), (b) in providing occupational knowledge (89 

percent)* and (c) for intellectua Impersonal development (91 
percent), 

5, The nficdian annual income for baccalaureates increased 
60 percent in five years or less after receiving their degrees. 

> 6, Intcigeneratiotial mobility was evident for 67 percent* 
7, Major areas of degrees were (a) arts/sciences disci- 
plines (54 percent)* (b) professional schools (46 percent). 

Information from the surveys has been used to Supply 
outcomes information to the State Ranning and Budgeting 
Office, to a national accreditation association, and to the 
Commission on Higher Education for degree proposals. 

Management information related to accountability and 
academic planning has resulted from data about graduates' 
degrcc^relatcdcmploynfient* income, evaluations of instruction 
and student servicest and from evidenced sociocconomie 
mobility. However* aeeountabtlity afUl aeadQinic planning must 
consider the graduates' purposes in obtaining degrees {eg. ,20 
percent of baccalaureates desired a general education). 
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THE ANATOMY OF A PRESIDENT'S 
INFORMATION SYSTEM 

C Thomas Innis 
Shepard Brum 
University of Cindnnati 

With the financial health ormaii> instKutions of higher 
education in senous doubtt the need for improved admrnisira- 
tion has been coupled with a plea for more mformatton and 
analysisoflhosefactorscntical to decision making. This paper 
deals with the work of a task force at the University of 
Cincinnati ^hich conducted a comprehensive analysis of tho!>e 
factors which cOntnbuted to the university's present financial 
plight. Four areas were singled out for study: 

1. Historical analysis of growth and expansion in the 
^ university budget 

2. Projections of future income and expenditure 

3. Control of future expenditure 

4. Identi. :ati6n of data essential to future decision 
making. . • 

-The work of the financial task force is examined in light of 
the decision framework of a university president's office and 
the type of information concemtng various aspects of the 
university operations required for improve<l management of die 
institution. The authors aigue that information systems as they 
am presently conceived lack the flexibility necessary to respond 
to the radically shifting financial clim^/x with which many 
colleges and universities fmd themselves confronted. Ton great 
degree, the utility of information systems iS hampered by the 
traditionally long Jead time necessary for development and 
implementation. Institutional resources would be better spentin 
increasing the depth of institutional studies capabilities. 

The paper, concludes with a discussion of a model for 
controlling the flow of information related to critical decision 
making by a university prcsi^Ienl. It is suggested that decision 
makingat the executive' vcj requires a unique configuration of 
information.' 

DETERMINANTS OF INSTITUTION AJb 
COMPAteABILITY 

Stefan D.Bioomfield ^ 
Oregon State University 
Allan L Service 

National Center for Higher Education Management Systems 

Increasing pressures for accountability in higher educa- 
tion, coupled with a growing appreciation for sound institu- 
tional management practices^ are producing an accelerated 
demand for^data from comparable institutions. The conviction 
that sUch data can better inform the decision-making process, 
has mot;vate<l a considen^bte effort to develop procedures and 
formats facilitating die int^nnstitutional cxchiange of informa* 
tion. However* little has been written on the fundamental 
concept of comparability tself— the ways in which institutions 
are comparable and how such comparability can be recognized 
and utilized. This paper discusses the factors determining die 
comparability of institutions of higher education. In particular* 
two diametrical definitions of comparable institutions are 
evaluated. The first relies upon the acknowledged value of 
learning from the experiences of others in similarcircumstances 
aqd defines as comparable those institutions that are (or have 
been) faced with essentially the sanie set of decision alterna- 
tives. The second interpretation adniits that insights oflen 
accrue from close examination of fundamentally unlike entities 
and defines as comparable any set of institutions chosen for 
analysis* without regard to their degree of similarity to the 
subject institution. 



UTILIZING MANPOWER SUPPLY AND DEMAND 
PROJECTIONS IN POSTSECONDARY EDUCATION 

Donald Norris 
University of Texas at Austin 

In recent ye^rs> considerable attention has been focused on 
manpowet issues in postsccondary education. Manpower 
2>upply and ^mand studies range all the v^ay from occupational 
surveys that emphasize the demand for vocational manpower to 
projections that assess (he supply and demand for Ph.D,'s in 
academia. [n addition to their renewed popularity, manpower 
studies have undergone technical improvements that extend the 
promise of providing more accurate and timely information in 
support of educational decision ma)cing. 

The purpose of this presentation is twofold. The first 
|>prtion briefly traces die devclopmentof manpower studies in 
education to suggest how thecurrent state ^f-the-art developed. 
This is important because past failures at accurate manpower 
projection have been caused largely by technological limita- 
tions and faulty assumptions that have often mirrored 
-conventional educational wisdom. 

The second portion of the presentation explores some of 
the mherent limitations to using manpower studies in post- 
secondary education. Some of these pitfalls relate to methodol- 
ogy and to the usability of information that is provided even by 
today's improved projections. Others focus on the sort of time 
frame needed for educational decision malcing. Others pertain 
to the assumptions about student marketplace behavior that are 
made by different projections. The relative utility of manpower 
studies also varies by institutional setting. 

The presentation concludes by attempting briefly to 
outline new research initiatives that may be leading to 
information that will assist future manpower studies. 



ONE-YEAR ENROLLMENT PROJECTIONS BASED 
UPON SURVEYS OF STUDENT INTENTIONS 

Matt Steele 
University of Miami 

fn a recent NCHEMS ^article entitled Higher Education 
Enrollment Forecasting (by Paul Wing), the.major forecasting 
techniques applicable to higher education were discussed. The 
various curve fitting and causal methods werf presefnted. These 
latter methods are the ones most widely used at present* and 
they will continue to be widely usedr of course. Hov^ver> ^ 
was emphasized by Wing^ all of these methods aie based upon 
past or historical data and upon the assumption that past trends 
will continue into the future. But wha( happens when trends 
change unexpectedly* as was the case when the attitudes toward 
higher education of the general public and of potential students 
changed in thc^arly 1970s?What happenedyras that theiriaior 
projections for the early 197Qs were higher than actual 
enrollment. The general problem is that of predicting turning 
points.. \ 

According to the NCHEM's article, one answer to this 
shortcoming of (he traditional techniques is to begin using 
surveys of student intentions in regard to future attendance 
plans. In the fall of 1972, sucriasericsofsurvcys^was begun by 
institutional research at the University of Miami. During the 
period since 1972* seven surveys have been conducted and 
regression equations derived* relating the correlation between 
the percent of students who indicate intention to return and the 
percent who actually do so. The survey has accurately predicted 
a major turning pomt in University of Miami enrollment* that is* 
a reversal from a declining to an increasing cnrollnncnt* 
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ADMISSIONS AND ENROLLMENT PLANNING: 
STRATEGIES FOR DETERMINING THE SIZE 
AND COMPOSITION OF THE STUDENT BODY 

Thomas J, Palmer 
WiUiatri P. Fenstemacher 
VnWersity of Massachttsetts tu Boston 

In a period of a stable ordeclining collegc-agc population. 
pO!^l5CC0ndury In^kEiluiions must develop innovative recniiimenl 
and admission strategies for achieving {he desired enrollment 
levels and population mix The University of Ma^isachu setts at 
BOiUon (UM6) hasdevelopcdenrollment objectives consisting 
of goals concerning not only overall enrollment level but also 
the charjc ten sties of the student body. The university is 
committed to enrolling a i^tudent body whieh fs representative 
(in terms ofscx^ race^ and income) of the general population in 
the Boston -metropolitan area. 

The size of the student body andenroElment levels for each 
college arc detennined by the campus and are related to the 
expected level of funding by the state legislature. Thus^ overall 
enrollment JevcJ is laigely predetermined in our planning 
process^ and the university must develop strategies for 
identifying and enrolling sufficjent numbers of students to meet 
the desired enrollmem levels but students who are also 
repn;scntative of the population in the Boston metropolitan 
area> 

A planning process is being developed that is based upon 
four types of infonnatioiT: (J) demographic population chanic- 
teristics of the Boston area available on U.S. Census tapes, (2) 
sceoadaiyand postsecotidaiyearolltnent projections for Massa- 
chusetts,(3)hisitoiicaldataoathe UMB app]ic'aatspoolTatid(4) 
demographic data on the eum;ntly enrolled population of the 
university. > ; 

This paper describes the teehniques used for. determining 
admissioas targets, illustrates the process used to provide 
infonnation v^tal to aa admissions rccnjitnient program* and 
deseribcs the ways sueh data ean be used to alter recruitment 
efforts and to fulfill an lastitution's enrollment objeetives. 



STUDENT ACCESS AND INSTRUCTIONAL QUALITY 
IN A TIME OF nSCAL CONSTRAINT 

Eugene Cniven 
Karen Beckh'ti 

University of Wiscotisitt System 

Can institutions of higher education continue the traduions 
of open aecess attd quality irstnjction as financial resources 
become Increasingly scarcer or must institutions choose 
between maintenance of student access t^ educational oppor- 
tunity and niaintenance of the quality of higher educaiinn 
services provided? 

This policy dilemma examined by specific reference to 
the University of Wisconsin (UW) System which» when 
ennfronted with this ehoicc in April 1975* reluctantly elected to 
establish quality -safeguarded enrollment ceilings fnr eaeh 
inStitutionF leading to a denial of institutional access to a 
number nf qualified Wisconsin residents in the fall of 1976. 

This aetion ratscU important policy question: What 
impact has the enrollment eeiling policy had upon student 
aeees*; to educational opponuftily'' In order to assess thi.s policy 
question, the uni verity undertook a telephone sample survey of 
those 4;tudents who were jud^d qu^iliOed for at^ission but 
who weru denied admission due to institutional enrollment 
ceilings. 

The Mudy sought answers to several poliey- related 
<iucstlnns: 



1. How many students were denied access to the UW 
System due to the enrollment poliey"? 

2. What happened educationally to prospective 
students who were denied access due to the enrollment poliey? 

3. Was the impact of the enrollnientceiling policy greater 
upon the applicants at certain institutions due to program 
uniqueness? 

4. Towhatextent diddenralofaccess toaUW institution 
impact students' educational plans? 

The results of this study served as a pnmai^ input into the 
university's decision conc^rnmg eontinuation of the policy of 
limited instructional access, 

THE SCOPE OF BARGAINING IN FOUR- YEAR STATE 
COLLEGES; AN UPDATE 

Gerald H. Kratfier 

Pittsburg Stat^ Utdversity. Ka/isas 

John IV. Creswell 

Oklohoma State University 

The purpose of this study is toexamine written agrce^nents 
between four-year j^tatc eoUeges and bargaining agents repre- 
senting faculty during the 1973-74 and 1 975-^76 academic 
years to detennine the scope or range of topies ineludcU in the 
agreement and to detennine if the scope had expanded over 
time. This study brings up to date a paper coacemed with the 
scope of bargaiaing in four-year state colleges during the 
1973-74 academie year that was presented at the Association * t 
for Inji;titutional Researx:h Sixteenth Annual Forum in l-os 
Angeles in Muy of 1976. 

Traditionally, scope of bargaining has been associated 
with the range of issues ineluded in negotiations, between 
parties to a labor agreement. Seope is oflen the fceal point of 
.eontroversy; frequently* college administrators look upon an 
expanding scope as an infringement on their rights to manage. 
To detennine scope* unions tend to utilize so-ealled model 
eontraets in presenting their demands to administrators. One 
sueh mO<lel is suggested by Miehael H. Moskow. The thirteen 
Moskow eriteria operationally define scope of bargaining and 
are used in this study to analyze the written agreements. 

Research questions are fonnulated by relatmg the scope nf 
negotiations for each written agreement to itjstitutional and 
eolleetive bargaining process variables. These institutioaal and 
, process variables are: size of the institution (underigraduate 
enrollment), growth or decline in unergraduate enrollment* 
type of faeulty organization (AAUPp AFT, NEA), coverage of 
the agreement (mu I ti- Institutional or single institutionalK 
eomposition of the bargaining unit (heterogenous or instniC' 
tional only)* nature of j^tate legislation imeet-confer or 
eolleetive bargaining law third- party intervention clauses, and 
presence of binding arbitration elauses. 

MONITORING TRENDS IN FACULTY SALARIES 

H. Paul GreerioHgh 
Marshiil! University' 

For four years, we have been computing a nonparametrie 
index of diserimination based on the Mann-Whitney test^ 
initially proposed by Gastwirth and slightly modtfied by the 
author. Tliis index taeitly assumes etjyally qualified groups, 
however, so we have recently been validating it with regression 
ttiodefs. 

The regression m0<iels use various combinations of 
independent variables, ineluding aeademic rank, academie 
expen'e'neet highest degrx:e held* department of employment, 
colle^;^ of employment, and so fonh. We used the sequential 
sum jifsquare^ method to subtract out the efTects of these and 
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other vanable^k. the rcmammg variation wa^k pdrtxixoned inro 
that accounted for by sgx <^nd the residual variation. After 
controlling Tor the ^^altent variables, we found that sex was not a 
sigmftcant predietor or salary. In the course of the study, we 
were also able to answer questions concemirig saiary difTeren 
tiaK letween departments, between degrees, b> expenenee, 
and b> nonteathing duties. We have recently begun to coalesce 
departments within similar disciplines in order to inercase the 
cample stze. Results of this are also reported. 

PLANNING FOR FACULTY FLOWS 

Gerald W, McLaughlin 
James /?. Montgomery 
Al^n VK. Smith 

Virginia Polytechnic Institute and State University; 

i 

This^paper offers alternative to previous proec<]ures 
used in projeeting Taeulty Hows.* This alterative is similar to 
prior work in that it ineludes the personnel aetivities.or attrition, 
promotion, and tenure. It differs from other i^odeJs by using 
data on the average demogf^hle.eharaeteristics of each type of 
faculty, unique by college, by level (for exairiple. professors in 
agneuJture or professors in arts & sciences). ^Tbese data are then 
used to predict proportion of the group w^nrh will be 
promoted, or tenured, or leave each year./ 

Jn this modeling procedure, forexample, the proportion of 
agneultural professors who remain as pculty members ^ 
function of such professors being in agr^cuJIum, their average 
age, and their amount of experience relative to others in the 
srAtjfs^ rank. The proportion promoted is a function of collegc> 
derivation of salary from avei^ salary at a given rank, and 
rank. The average years of experience and age of those leaving, 
used to update experience and ^g<^> is ^ function of college, 
mk, and tenure. The numbly tenured is a function of the 
number in the last year of probation anda policy decision on the 
approximate proportion of this category who will receive 
tenure. Input data include the number and aven^ age of 
tenured and untenured faculty hired at each rank into each 
college. Default parameters exist for these if one wants to 
assume continuation of prior practices. 

The model has been tested and fpund to provide a good fit 
with actual faculty characteristics. The final section of the paper 
reviews areas requiring further development. 

A G0AL*PR0GRAMM1NG MODEL FOR FACULTY 
TEACHING LOAD EQUALIZATION 

Robert T. Lewis 

Georgia Institute ofTechtwlogy 

fn a university where program enrollments arc changing 
and restrictive faculty recniitment policies are fa effects wide 
variations in taeuJty teaching loads develop over time. 
Academic managers can respond to this situation in several 
ways. One response might be to encourage the sharing of \ 
faculty bctM^cn schools and colleges in order to teach courses 
that are similar in content. Before implementing such a policy , 
it would be useful to have some measure of the equalization in 
.teaching loads that wouJd result. One type of model that 
provides a framework within which one can Investigate the 
policy of sharing faculty is a goal -programming model (a 
variation of linear programmir^. .The goal -programming 
model discussed in this paper has' as its objective the 
minimization of the sum of the surplus (too much) instnictional 
capacity and the slack (too little) instnictional capacity for all ^ 
departments. Itsjronstraintsarethc number of faculty available \ 
in each department and their ability to teach in other 



departments. For the data used *n testing, which tomes from a 
real setting, significant reductions in leaching toad variations 
result from application of the model Also, the modeJ is 
extended to incorporate faculty teachlr^ preferences. With this 
addition, the need for differentially weighing faculty prefer^ 
ences and instnictionaJ loads becomes apparent. Hence. In one 
model three elements of short range instnictional planning aie 
combined. They are. (J) the demand for instniction, (2) the 
faculty available to satisfy the demand and their work loads and 
preferences, and (3) the priorities for resolving conflict between 
the first two elements. 

CONTEXT OF RESEARCH AND PLANNING IN 
HIGHER EDUCATION: AN ECOLOGICAL VIEW OF 
PLANNING IN HIGHER EDUCATION— THE MACRO 
SYSTEM IMPLICATIONS FOR INSTITimONAL 
PLANNI?^ 

Alex J. Ducanis 
Mary Ann Hvizdos 
University of Pittsburgh 

Planning is a means of rational assessment of what it is we 
wishtodoorbeand the means nece^^sary to reach that slate. Uis 
a process of deciding which of several alternative futures we 
wish to have. 

A plan is a framework within which development occurs. 
The plan presents opportunities which will permit institutional 
improvement to a gi^tc^ extent than institutional development 
on the basis of expediency. The plan is a statement of beliefs 
concerning the scope and direction of movement of ^ 
Institution. 

Plans in higher education, at least durir^ the postwar 
period, were concerned primarily with the rapid increase in 
numbers of students and the provision of educ'^tionaJ facilities 
for them. While numbers am still a concerr , qualitative and 
contextual considerations arc now becoming more mlevant. 
Planners are becoming slightly more M)phisticatcd in their 
approach to the plaming process. It is now probable that plans 
will pertain more to the qualitative aspects of the invitational 
mission thanwith the quantitative! aswas the case in the 1960s. 

The planning process* of nece^ity, must recognize the 
existing situation on both a current and historical basis> for 
planning takes pJace within the context and will in tum change 
the contextual variabJes. Recognition of those factors over 
which the planner has varying control (e.g., birthrate> 
govemment policy) must be part of die planning process. 

Higher education is reviewed as a subset of the ecosystem 
with i^fcmnce made to its interaction with other parts of the 
system. Anattempt is made to develop a conceptual base which 
may be useful to planners in dealii^ with the multitude of 
factors in the environment which may have an effect upon 
tnstitutionaJ planning. Speciftcally, the paper examines popula- 
tion trends, economic and social conditions, technological 
developnient, public policy and political conditions as factors 
which have had an impact upon the planning in higher 
education in the past as well as the possible impact of such 
factors in the future. Planning models are discussed and 
comparisons made between selected pJans (both institutional 
and systemwide) and the actual outcomes of those plans* 

THE MISSING LINK IN INSTITUTIONAL RBSEARCK 

Will'iani D.Cohen ^' 
University ofWashington 

This paper proposes and examines the mis«ing link to the 
current institutional research (IR) ty^logy of sttaiegics for 
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dealing with cvciyday crisis^ a tlicoiy of sircss utilization* 
Operation alizing ihi:: concept provides a mechanism whereby 
offices of could increase their functional effieiene^ through 
recognition and study of situations and/or tasks which lead to 
stress In administrative personnel, Including IR officers. 

The studyt in progress, evaluates higher education 
admin isirator reaction (o tension-pfodueing situations or tasks* 
i,e., potential stres<M>rs whieh generate the erisis atmo:;phere 
eharacteristic of many IRofftees, The situations typify the IR- 
administrative relationshfp where IR offices react to exigen- 
eies or pressures delegated to them by administrators. Tasks 
were developed from five areas of coneentrated administiative 
dec! si on- making activity — typically demanding a constant flow 
of relevant inlormation from oflHces of IR, Areas are: (a) 
academic program review^ (b) faeulty position allocation^ <c) 
institutional goal setting, (d) faculty performance evaluation^ 
and <e) budgeting. The study explores a potential eausal 
relationiihip between the situational tasks and vaiying levels of 
autonomie indiees of stress <e,g,i heart rate* r^piration rate» 
and bjood pressure), spccifie IR techniques or strat^ies* and 
the quality of administrative decision making. 

Study of adminisirati ve performance relative to specifie 
situational tension production may^ggest means to.achieve 
more effective IR stafTutilizatton^ more functional communica- 
tion networks, and more effleient IR means of data assimdatton 
and infomiation production. The net result may be Increased 
efficiency in information transmission — measurable m c^ahty 
and acceptability of administrative decision making. 



DEVELOPMENT AND APPLICAHON OF A MODEL 
FOR EFFECTIVE USE OF INSTITUTIONAL 
RESEARCH FINDING Ji A LONGITUDINAL 
CASE STUDY 

Ztta M* Catuweti 

Brooklyn CoiUge of the City University of New York 

This paper presents jata relevant to the development and 
application of a model for effective use of institutional research 
findings in the area of euiriculum evaluation in higher 
education* The modeK which has potential for international 
applieabihty. rests on several piemises. Firsts the educational 
mission of the higher education institution Is of primary 
significance. Seconds implementation of this mission must be 
eharacterized by flexibility and reflect responsiveness to needs 
of (aeulty and students^ cost constraints^ long-range higher 
education planning, and broader issues. e,g,. short- and long- 
term economic outlook. Third, curriculum evaluation by an 
Institutional research facility can have a meaningful impact only 
wticn a defined and functioning relationship exists and is 
maintained between the institutional research ofTice and the 
academic department — its faeulty and students, 

Tfie ptvscntation is in the fomi of a longitudinal 
(1968- 1976) case study of the manner in whieh one function of 
institutional research^ evuluatron of the etfcctivencss of 
curri'^ulum in a given jaeademie diSeipHnef has Kad^ and 
continues to have^ a si^nifleant and identiriable impact on 
academic policy decisions related to currieu|um study review, 
amendmept and j^vtsion^ as well as development. The 
longitudinul case 'i^tudy prcsentation has reference to seven 
research studies and a systematic design for research which 
have been completed by institutional research personnel in 
cooperation with faculty and students of the academic 
department. This research work has contributed dircetly to a 
pilot eurrkulufnrcvision.am^reumculumdevelopment.and 
continuing curriculum rcvtcw within one ucademic discipline. 



DETERMINING REALIZABLE DEMAND FOR NEW 
ADULT> CONTINUING, AND N ON TRADITIONAL 
POSTSECONDARY PROGRAMS 

c 

George J, Nolfi 
University ConstdtamSf f,ic. 

In this paper^ the several approaches to the analysis of need 
or of demand for adult learning oppominities whieh have been 
applied in several states are rcviewe^ and discussed. The 
assumptions and pitfalls of adult education demand <)nalysis are 
examined^ particularly insofar as the difTcfenee between 
estimated demand and the enrollments actually realizable aie 
concerned, 

AFFECTiVE DEVELOPMENT OF ADULT STUDENTS 

Laurence C, Lipseti 
A, Nancy Avakian 
Empire State CoHege 

Colleges profess to promote intellectual development in 
their students. Some atsj claim to have an influence on 
students' personality developments, A study was undertaken to 
measurc affective ehanges in adult students in traditional and 
non traditional postsecondaiy educational institutions. 

The rcsults of the study indicated that students in 
Indivlduall^d external degree programst sueh as thatsOffercd 
by Empirc State College, showed positive ehanges in overall 
affective developmentt while different groupsof adult students 
In conventional college programs showed noehanges during the 
same prctest andposttest period. In addition^ dtfTercnttatlonin 
affective changes amopg Empirc State College students werc 
found on the bases of sex , age^ occupation , field of academic 
concentration^ employment* and cnrollnficnt status^ Older 
students tended to rank higher in most aspects of affective, 
development, Therc wa^ a tendency for wonfien and younger 
students to scorc lower on the pretest scales and to change more 
than men and older students. Students in human service areas of 
study tended to rank highest in these factors: inercasing 
awarcncss and self-understanding and understanding others. 
Business students ranked highest in the faaon ^If-eonsistency. 

Since instruments for measuring affective fuetors are not 
readily availablet an important rcsuh of ihis study was made in 
regard to measurement technology. Two instruments were 
developed* ihe Q-sort instruntent and the paired comparison* 
Neither Instru ment showed especially high rcliability; noncthe^ 
less, both were capable of measuring factors in the affective 
domain. The force d*choicCf paircd comparisbn instrument 
borrowed the flexibilityof item construction foundtn the Q-sort 
instrument and rcsults wcte obtained with loss rcsistance by 
subjects and in less time, 

A TELEPHONE APPROACH TO NEEDS ASSESSMENT 

George R, Moore 
Chemeketa Community Coliege 

Today^ as compaitsd to the decade of the sixties, 
community and junior college leaders arc devoung nuieh 
attention to the concept of community-based cductition' 
Basically', this concept suggests that the college can work with 
the community to define learning needs morc cfTeettvely* It also 
Implies that solutions to meeting exprcssed learning needs can 
become more identified and that the solutions will be better 
supported ai^ understood by the community. 

To adders this (ssue, an ad hoc planning group of 
Chemeketa Community College staff was organized in the fall 
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of 1975 to detenninc the most appropriate method for 
conducting a ^comprehenfilve needs asse&sment of district 
residents. 

The geneml purpose of lhi« paper is to describe the 
planning and implementation of a telephone approach to 
assessing community attitudes^ opinions.^and beliefs. More 
specifically* this p?' er desc.ibes the criteria used to select the 
mcthodi the objectives of the survey, the various stages of 
implementation, and evaluation of the work asperceived by 
residents* staffi and budget planners. ' 

INFLUENCES OF NON- CANADIAN-TRAINED 
FACULTIES UPON PROGRAM CONTENT 

Charles H. Belanger 
Oniversite i^c Montreal 

This study ^as an attempt (a) to assess the dependence of 
selected Canadian institutions upon foreign countries to train 
their academic staffs (b) to detcnnme the retation^ip between 
non-Canadian-tn med faculiie& and program content in selected 
disciplines (economics^ historyt political science^ and sociology/ 
anthropology)^ and 0) to appraise the progress toward 
the Canadian ization of progmmsoverthe past five years. Afler 
obtaining data related lo the country of trainiitg for each faculty 
member and d^temiining ihe number of Canadian content- 
ori^^nted courses in the department corresponding to each 
faculty nfiembcn a statistical analysis was conducied to find out 
whether or not there was a relationship between these two 
variables. 

AN EXAMINATION INTO THE FEASm^LHT OF . 
USING A MARGINAL COST-BASED UODEh FOR 
STATE-LSVEL HIGHER EDUCATION BUDGETING 

EdwariiH.Lyell 
Vniversity af Colorado 

This paper examines attitudes of college administrators 
and state budget officenk toward the information provided by a 
macro marginal cost-based higher education model. A macro 
model hasbeen developed based upon difTeTentiatirtg costs into 
fixed and variable* The model is designed to aH in examining 
policy issues regarding the funding of public higher education. 
The m? 770 marginal cost model pennltscxamination of policies 
related to the level of fixed eost which can be attained without 
eliminating Institutional Hexibiliiy and of policies to choose 
which institutions should grow or decline inorderto minimize 
state cost. 

The author developed the need toexaminc marginal com in 
making resource allocation decisions based on his literature 
review on higher education costing and budgeting and his own 
work with a state coordinating commission and legislative 
bMdgcting committee. 

The marginal costing model uses the SPS (formerly 
SPEPM) modeling framcwor*; t^^veloped at NCHEMS. The 
moilcl ts run u&ing da:a Trom several '^^uituiions to develop an 
understanding of institutional characteristics which may be 
currelatcU with institutrona) marginal cost behavior 

An extensive biblii.graphy on marginal costing is also 
prcM^nted. A sectionon rcM^arch extensions includes discussion 
on the need to explore marginal techniques for institutional 
analysis* 



COST-EFFECTIVENESS OF TECHNOLOGICAL 
INNOVATION IN HIGHER EDUCATION: THE ROLE^ 
OF INSTITUTIONAL RESEARCH 

Leslie Wagner 

Polytechnic of Centra! London 

lii^fitutional research into media innovation has concen- 
trated Jaigeiy cn the two major areas of cost and educational 
effect ivencss. This p^pcr studies costs, pnmarily* and consists 
of three parts: The first is a survey of the results of research by 
the author and others into the cost-enectiveiie-Ss of techno- 
logical innovations in the United States and United Kingdom 
higher education institutions, .\mong the innovations covered 
are a computer-assisted learning projects a distance -learning 
audiovisual projeet» as well as the United Kingdom Open 
University. The seeond i^ ^ study of the implieations of cost- 
effectiveness analysis for relationships with funding bodies and 
for institutional decision makingt particularly decisions con- 
cemed with establishmciUi closure* expansion or contraction 
Finallyt there is an analysis of the role of institutional research 
as a manageiiient and administrative tool and the problems 
indicated by the case studies in reconeilir^ managerial and 
research objectives. 

THE GRADUATION EXPERIENCE OF 
DISADVANTAGED STUDENTS IN THE SENIOR 
COLLEGES OF CUNY 

Lawrence Podell 

City Vniversity of New York 

Judith Pi'fsco 

New York University 

The SBBK program is a compensatory effort of the City 
University of New York (CUNY) to provide services intended 
to enable disadvantaged students to successfully complete their 
education at itsfour-yearcolleges. With the implementation of 
an open admissions policyt similar students began to enroll in 
the senior colleges of CUNY, malcing a comparative study 
possible. This paper concems the retention and graduation of 
disadvantaged students (those in the SBBK program and those 
not accepted* by random proceduresi into the program) in 
CUNY four, five, and six years after their initial enrollment.' 

FACTORS RELATED TO ATTRITION PUBLIC* 
URBAN commuting; INSTITUTIONS 

Anita Kramer 

Wiltiam P- Fenstemadier 

Vniversi ^ of Massachusetts at Boston 

This study is among the first attempts to determine the 
factors relating to attrition in public, urban commuting 
institutions. Most previous work has focused on atltrition from 
private residential college^ or universities where a much more 
homogeneous stu^lent body is enrolled. The study was designed 
to explore the attiiude^k, perceptionst ,^nd operiences of 
students who have withdrawn firom the University of Massa- 
chusetts at Boston (UMass/Boston). Three main areas in which 
a student moves while in school were examined* academic^ 
social, and employment. The questionnaire used in thi& study 
wa& derived from pa&t student and ^ttntion studies, literature on 
attrition, and questions posed bjLthe particular environment at 
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UMass/Boston. A second part of [he stuJy involved q control 
group — students who have not withdrawn from the university. 

The results of the study show some dtfl^r^nee:; between 
fuclor^f found important in traditional insiitutions' atlrilion rates 
and those faetors that influenee UMass students to witndraw. 
panieularly those involving various subgroups of the popula- 
tion. The university ineMcif a higlier percentage of older icif- 
!;upponing,and married students with family resDOosibilifLcs.lt 
is these characteristics that ofter tnnucnccU^ in numerom.wayi. 
the students* perceptions, eommitments, and tntegratio.i :nlo 
the university eommunity and, hcnee, their decisions to 
withdraw. The findings also point out that the group of 
withdrawals and the group of persisters <lo not differ signifi- 
cantly from each other in terms of these eharaeteristies. It is the 
eomplex interrelationships among the&e varubles and the 
university environment that inpuencc ^ome ^tudcnt!> to with- 
draw while others remain in school. 

fn addition, the problems of servicing and supplying 
information to a Mudent body v^hosc tjmeon t^ampu^ isljmucd, 
and whose awarenes!> of the university environment is 
subsequently afTcclCil* v^a& made apparent in this &tudy. 

Although the ^tud> ^^as performed at one institution, the 
development of the questionnaire and the i!>sues that arc eovervd 
ensure that both the findings and the resulting policy 
rccommendattons can be u!>eful to other urb^in commuting 
institutions. 

"NUMERUS CLAUSUS" IN WEST GERMANY— ^ 
PROBLEMS AND SOLUTIONS 

Eberhard Jobst 

BumUamter Konimission fur Bifdungsplmning imd 
Forsktmgfordemig. West Germany 

Free acees. to higher education is generalty guaranteed by 
constitutional law. Demographic developments ano the relative 
rise of university entrants have led to serious problems in recent 
years. In spite of tncrcascil capacities, the number of applicants 
exceeds the number of available places in many study areas. 
Therefore, ''numcrus elausus''* regulations have come into 
effects thus limitiiTg access to higtier education. 

Reliable criteria to guarantee equal chances for all 
applicants are still missing Various means tiave been tested or 
are being considered for introduction Measuring the capacity 
of universities is equally dtfriculi but necessary for the effective 
use of the available places in higher education. 

Pcdagt^ieal repercussions and social Implications as well 
as eouii rulings necessitate an immediate ehange in admission 
legulattons. * 



Various measures undertaken in the prst and current 
proposals arc discussed- Also* cmergenCi: measures unul 1990 
when the number of students will drop sharply is taken into 
consideration, fn addition* some thought is given to a 
prospective disequilibrium between the educational sector 
(university output) and the labor market. 
'A 

PLANNING ACTIVITIES OF GERMAN UNIVERSITIES 
WITHIN THE FRAMEWORK OF FEDERAL 
LEGISLATION 

Amelicse ^- Orueger 

UnWersUiU Diisseldorf. West Germany 

The educational mission of West German univen>itic!k 
ensured by the effectiveness of partial planning. Mjjniy, 
however^ this is on a short-term basis and primarily in the field 
of budgetary operations and commitments. If the partial 
planning is novt meticulously rcgulatea (by hxvtitt oniinanccst 
and enforcement by administrative eourt!>)t it carries an 
imminent tendency tooutgrov^ its initial)) Intended seopc. Tht& 
development is characterized by the existence of a great number 
of plans of many kinds and &hapc$. The obviou!> lack of 
coordination among the federation* the stales and the universi- 
ties tends 10 impede the formulation of baMC principles and 
operational purposes for long-term planning. The constitutional 
structure of the Federal Republic* whcie the >^^><n planr.*ng 
authority remains with the respective state legislation and 
ad ministration « naturally limits the regulatory role of federal 
legislation. Recent federal legislation* however* provided a 
framework for the integration ofplanning with spceial reference 
to the incorporation of cost measurement. 

COORDINATING STATEWIDE EDUCATfONAI. 
NEEDS: A SYSTEMS APPROACH 

JmiesJ' McGovern 

fUlnols Board of Higher Education 

The paper pi^scnts a systems analysis of virious educa- 
tional issues such as public vs. private college funding, .student- 
aid formulae* non traditional ertniits vs. :edueatton and the 
hierarchy of needi^ for personal development* aduh education 
and professional {raining. The theme the tnteraction of the 
varjou!> parts and formi> of higher edc Mion. The systems 
approach considers the total environment (e.g.* biological 
ecology* city planning* etc.) and is an unknown necessity for 
effective tesearch planning and budgeting in a multicampus or 
eomprchcnsive setting. 
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